Reproduction device, reproduction method, and recording medium

ABSTRACT

The present technology relates to a reproduction device, a reproduction method, and a recording medium capable of displaying graphics with a broader dynamic range of luminance and appropriate brightness. 
     An optical disc records STN_table associating HDR graphics, which are graphics having a second luminance range different from and broader than a first luminance range, with tone_mapping_info including HDR information indicating a luminance characteristic of the HDR graphics and tone_mapping_info, which is tone mapping definition information used when luminance conversion from the HDR graphics to STD graphics which are graphics having the first luminance range is performed, the HDR graphics, and the tone_mapping_info. The present technology is applicable to a recording medium recording graphics.

TECHNICAL FIELD

The present technology relates to a reproduction device, a reproductionmethod, and a recording medium, and more particularly, to a reproductiondevice, a reproduction method, and a recording medium capable ofdisplaying graphics with a broad dynamic range of luminance andappropriate brightness.

BACKGROUND ART

As recording media for content such as movies, there are Blu-ray(registered trademark) discs (hereinafter appropriately referred to asBDs). In the related art, authoring of subtitles contained in BDs orgraphics of menu buttons or the like manipulated by users is performedby compressing dynamic ranges of master graphics on the assumption thatcontent is viewed with monitors of standard luminance (100 nits=100cd/m²).

Graphics which are masters have dynamic ranges equal to or greater thandynamic ranges displayable on monitors of standard luminance. When thedynamic ranges of the master graphics are compressed, the dynamic rangesobviously deteriorate.

CITATION LIST Patent Literature

Patent Literature 1: JP 2009-58692A

Patent Literature 2: JP 2009-89209A

SUMMARY OF INVENTION Technical Problem

With advances in display technologies for organic electroluminescence(EL) displays, liquid crystal displays (LCDs), and the like, monitorsbrighter than standard, such as 500 nits or 1000 nits, are being sold.There are demands for graphics suitable for performance of monitors withsuch broad dynamic ranges.

The present technology has been conceived in view of such a situationand aims at displaying graphics with a broad dynamic range of luminanceand appropriate brightness.

Solution to Problem

According to a first aspect of the present technology, there is provideda reproduction device including: a reading unit configured to readassociation information, extended graphics, HDR information, andluminance conversion definition information from a recording mediumhaving recorded therein the association information which associates theextended graphics, which are graphics having a second luminance rangedifferent from and broader than a first luminance range, with the HDRinformation indicating a luminance characteristic of the extendedgraphics, and the luminance conversion definition information used whenluminance conversion from the extended graphics to standard graphicswhich are graphics having the first luminance range is performed, theextended graphics, the HDR information, and the luminance conversiondefinition information; a conversion unit configured to convert theextended graphics into the standard graphics based on the luminanceconversion definition information associated with the extended graphicsin the association information; and an output unit configured to outputthe extended graphics and the HDR information associated with theextended graphics in the association information to a display devicewhich is capable of displaying the extended graphics, and to output thestandard graphics converted by the conversion unit to a display devicewhich is not capable of displaying the extended graphics.

A reproduction method according to the first aspect of the presenttechnology corresponds to the reproduction device according to the firstaspect of the present technology.

According to the first aspect of the present technology, associationinformation, extended graphics, HDR information, and luminanceconversion definition information are read from a recording mediumhaving recorded therein the association information which associates theextended graphics, which are graphics having a second luminance rangedifferent from and broader than a first luminance range, with the HDRinformation indicating a luminance characteristic of the extendedgraphics, and the luminance conversion definition information used whenluminance conversion from the extended graphics to standard graphicswhich are graphics having the first luminance range is performed, theextended graphics, the HDR information, and the luminance conversiondefinition information; the extended graphics are converted into thestandard graphics based on the luminance conversion definitioninformation associated with the extended graphics in the associationinformation; the extended graphics and the HDR information associatedwith the extended graphics in the association information are output toa display device which is capable of displaying the extended graphics;and the converted standard graphics is output to a display device whichis not capable of displaying the extended graphics.

According to a second aspect of the present technology, there isprovided a recording medium recording: association informationconfigured to associate extended graphics which are graphics having asecond luminance range different from and broader than a first luminancerange with HDR information indicating a luminance characteristic of theextended graphics, and luminance conversion definition information usedwhen luminance conversion from the extended graphics to standardgraphics, which are graphics having the first luminance range isperformed; the extended graphics; the HDR information; and the luminanceconversion definition information. A reproduction device reproducing therecording medium performs processes of reading the associationinformation, the extended graphics, the HDR information, and theluminance conversion definition information from the recording medium,converting the extended graphics into the standard graphics based on theluminance conversion definition information associated with the extendedgraphics in the association information, and outputting the extendedgraphics and the HDR information associated with the extended graphicsin the association information to a display device which is capable ofdisplaying the extended graphics, and outputting the converted standardgraphics to a display device which is not capable of displaying theextended graphics.

According to the second aspect of the present technology, there isrecorded association information configured to associate extendedgraphics which are graphics having a second luminance range differentfrom and broader than a first luminance range with HDR informationindicating a luminance characteristic of the extended graphics andluminance conversion definition information used when luminanceconversion from the extended graphics to standard graphics which aregraphics having the first luminance range is performed, the extendedgraphics, the HDR information, and the luminance conversion definitioninformation.

According to a third aspect of the present technology, there is provideda reproduction device including: a reading unit configured to readassociation information, extended graphics, HDR information, andluminance conversion definition information from a recording mediumhaving recorded therein the association information which associatesstandard graphics, which are graphics having a first luminance range,with the HDR information indicating a luminance characteristic of theextended graphics, which are graphics having a second luminance rangedifferent from and broader than the first luminance range and theluminance conversion definition information used when luminanceconversion from the standard graphics to the extended graphics isperformed, the standard graphics, the HDR information, and the luminanceconversion definition information; a conversion unit configured toconvert the standard graphics into the extended graphics based on theluminance conversion definition information associated with the standardgraphics in the association information; and an output unit configuredto output the extended graphics converted by the conversion unit and theHDR information associated with the standard graphics before theconversion in the association information to a display device which iscapable of displaying the extended graphics, and to output the standardgraphics to a display device which is not capable of displaying theextended graphics.

A reproduction method according to the third aspect of the presenttechnology corresponds to the reproduction device according to the thirdaspect of the present technology.

According to the third aspect of the present technology, associationinformation, extended graphics, HDR information, and luminanceconversion definition information are read from a recording mediumhaving recorded therein the association information which associatesstandard graphics, which are graphics having a first luminance range,with the HDR information indicating a luminance characteristic of theextended graphics, which are graphics having a second luminance rangedifferent from and broader than the first luminance range and theluminance conversion definition information used when luminanceconversion from the standard graphics to the extended graphics isperformed, the standard graphics, the HDR information, and the luminanceconversion definition information; the standard graphics are convertedinto the extended graphics based on the luminance conversion definitioninformation associated with the standard graphics in the associationinformation; the extended graphics converted in the conversion step andthe HDR information associated with the standard graphics before theconversion in the association information are output to a display devicewhich is capable of displaying the extended graphics; and the standardgraphics are output to a display device which is not capable ofdisplaying the extended graphics.

According to a fourth aspect of the present technology, there isprovided a recording medium recording: association information whichassociates standard graphics which are graphics having a first luminancerange with HDR information indicating a luminance characteristic of theextended graphics which are graphics having a second luminance rangedifferent from and broader than the first luminance range and theluminance conversion definition information used when luminanceconversion from the standard graphics to the extended graphics isperformed; the standard graphics; the HDR information; and the luminanceconversion definition information. A reproduction device reproducing therecording medium performs processes of reading the associationinformation, the extended graphics, the HDR information, and theluminance conversion definition information from the recording medium,converting the standard graphics into the extended graphics based on theluminance conversion definition information associated with the standardgraphics in the association information, and outputting the convertedextended graphics and the HDR information associated with the standardgraphics before the conversion in the association information to adisplay device which is capable of displaying the extended graphics, andoutputting the standard graphics to a display device which is notcapable of displaying the extended graphics.

According to the fourth aspect of the present technology, there isrecorded association information which associates standard graphicswhich are graphics having a first luminance range with HDR informationindicating a luminance characteristic of the extended graphics which aregraphics having a second luminance range different from and broader thanthe first luminance range and the luminance conversion definitioninformation used when luminance conversion from the standard graphics tothe extended graphics is performed, the standard graphics, the HDRinformation, and the luminance conversion definition information.

Advantageous Effects of Invention

According to the present technology, it is possible to displaybrightness proper for graphics having a broad dynamic range ofluminance.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating a configuration example of a firstembodiment of a recording and reproduction system to which the presenttechnology is applied.

FIG. 2 is a diagram illustrating an example of signal processing inmode-i.

FIG. 3 is a diagram illustrating the flow of a signal processed inmode-i.

FIG. 4 is a diagram illustrating an example of signal processing inmode-ii.

FIG. 5 is a diagram illustrating the flow of a signal processed inmode-ii.

FIG. 6 is a diagram illustrating the configuration of an access unit inan HEVC scheme.

FIG. 7 is a diagram illustrating the syntax of Tone_mapping_info.

FIG. 8 is a diagram illustrating an example of information used asdefinition information of tone mapping and HDR information.

FIG. 9 is a diagram illustrating an example of a tone curve shown byTone_mapping_info of tone_map_model_id=0.

FIG. 10 is a diagram illustrating an example of a step function shown byTone_mapping_info of tone_map_model_id=2.

FIG. 11 is a diagram illustrating an example of a polygonal linefunction shown by Tone_mapping_info of tone_map_model_id=3.

FIG. 12 is a diagram illustrating an example of each piece ofinformation included in the HDR information.

FIG. 13 is a diagram illustrating an example of a management structureof an AV stream in a BD-ROM format.

FIG. 14 is a diagram illustrating the structure of Main Path and SubPath.

FIG. 15 is a diagram illustrating an example of a management structureof a file.

FIG. 16 is a diagram illustrating the syntax of STN_table.

FIG. 17 is a diagram illustrating the syntax of StreamCodingInfo.

FIG. 18 is a diagram illustrating the syntaxes of [Video Block] and[Graphics Block] in FIG. 17.

FIG. 19 is a diagram illustrating a configuration example of a displayset of a PG stream and an IG stream.

FIG. 20 is a diagram illustrating the syntax of XPDS.

FIG. 21 is a block diagram illustrating a configuration example of arecording device of the first embodiment of the recording andreproduction system to which the present technology is applied.

FIG. 22 is a block diagram illustrating a configuration example of anencoding processing unit in FIG. 21.

FIG. 23 is a block diagram illustrating an example of signal processingby an HDR-STD conversion unit.

FIG. 24 is a diagram illustrating an example of tone mapping.

FIG. 25 is a block diagram illustrating a configuration example of areproduction device of the first embodiment of the recording andreproduction system to which the present technology is applied.

FIG. 26 is a block diagram illustrating a configuration example of agraphics decoding processing unit in FIG. 25.

FIG. 27 is a block diagram illustrating a configuration example of adisplay device.

FIG. 28 is a flowchart for describing a recording process of therecording device in FIG. 21.

FIG. 29 is a flowchart for describing an encoding process of mode-i inFIG. 28.

FIG. 30 is a flowchart for describing an encoding process of mode-ii inFIG. 28.

FIG. 31 is a flowchart for describing a Data Base information generationprocess in FIG. 28.

FIG. 32 is a flowchart for describing a reproduction process of thereproduction device in FIG. 25.

FIG. 33 is a flowchart for describing a decoding process of mode-i inFIG. 32.

FIG. 34 is a flowchart for describing a decoding process of mode-ii inFIG. 32.

FIG. 35 is a flowchart for describing a display process of the displaydevice in FIG. 27.

FIG. 36 is a diagram illustrating a configuration example of an AVstream in a second embodiment of the recording and reproduction systemto which the present technology is applied.

FIG. 37 is a diagram illustrating the syntax of a Tone_map stream.

FIG. 38 is a diagram illustrating the syntax of StreamCodingInfo in thesecond embodiment.

FIG. 39 is a diagram illustrating a configuration example of an encodingprocessing unit in the second embodiment of the recording andreproduction system to which the present technology is applied.

FIG. 40 is a diagram illustrating a configuration example of areproduction device of the second embodiment of the recording andreproduction system to which the present technology is applied.

FIG. 41 is a block diagram illustrating a configuration example of agraphics decoding processing unit in FIG. 40.

FIG. 42 is a flowchart for describing a recording process according tothe second embodiment of the recording device.

FIG. 43 is a flowchart for describing an encoding process of mode-i inFIG. 42.

FIG. 44 is a flowchart for describing an encoding process of mode-ii inFIG. 42.

FIG. 45 is a flowchart for describing a Data Base generation process inFIG. 42.

FIG. 46 is a flowchart for describing a reproduction process accordingto the second embodiment of the reproduction device.

FIG. 47 is a flowchart for describing a decoding process of mode-i inFIG. 46.

FIG. 48 is a flowchart for describing the details of the decodingprocess of mode-ii in FIG. 46.

FIG. 49 is a diagram illustrating a configuration example of a displayset of a PG stream and an IG stream in a third embodiment.

FIG. 50 is a diagram illustrating an example of the syntax of an XPDS inFIG. 49.

FIG. 51 is a diagram illustrating an example of the syntax of a TDS inFIG. 49.

FIG. 52 is a diagram illustrating a configuration example of an encodingprocessing unit of the third embodiment of the recording andreproduction system to which the present technology is applied.

FIG. 53 is a diagram illustrating a configuration example of areproduction device of the third embodiment of the recording andreproduction system to which the present technology is applied.

FIG. 54 is a block diagram illustrating a configuration example of agraphics decoding processing unit in FIG. 53.

FIG. 55 is a flowchart for describing an encoding process of mode-i inthe encoding processing unit in FIG. 52.

FIG. 56 is a flowchart for describing an encoding process of mode-ii inthe encoding processing unit in FIG. 52.

FIG. 57 is a flowchart for describing a Data Base information generationprocess in the third embodiment.

FIG. 58 is a flowchart for describing a decoding process of mode-i in adecoding processing unit in FIG. 53.

FIG. 59 is a flowchart for describing a decoding process of mode-ii inthe decoding processing unit in FIG. 53.

FIG. 60 is a diagram for describing a screen generated based on a BDJobject.

FIG. 61 is a diagram for describing tone_mapping_info at the time ofvideo reproduction in a fourth embodiment to which the presenttechnology is applied.

FIG. 62 is a diagram illustrating an example of a command at the time ofvideo reproduction.

FIG. 63 is a diagram for describing tone_mapping_info at the time ofvideo stop in the fourth embodiment to which the present technology isapplied.

FIG. 64 is a diagram illustrating an example of a command at the time ofthe video stop.

FIG. 65 is a diagram illustrating a class structure of a BDJapplication.

FIG. 66 is a diagram illustrating a class structure of the BDJapplication.

FIG. 67 is a diagram illustrating a configuration example of a recordingdevice of the fourth embodiment of the recording and reproduction systemto which the present technology is applied.

FIG. 68 is a block diagram illustrating a configuration example of anencoding processing unit in FIG. 67.

FIG. 69 is a block diagram illustrating a configuration example of thefourth embodiment of a reproduction device 2 to which the presenttechnology is applied.

FIG. 70 is a flowchart for describing a recording process of therecording device in FIG. 67.

FIG. 71 is a flowchart for describing a BDJ screen reproduction processof the reproduction device in FIG. 69.

FIG. 72 is a block diagram illustrating a configuration example of acomputer.

DESCRIPTION OF EMBODIMENTS First Embodiment

(Configuration Example of First Embodiment of Recording and ReproductionSystem)

FIG. 1 is a diagram illustrating a configuration example of a firstembodiment of a recording and reproduction system to which the presenttechnology is applied.

The recording and reproduction system in FIG. 1 is configured to includea recording device 1, a reproduction device 2, and a display device 3.The reproduction device 2 and the display device 3 are connected via aHigh Definition Multimedia Interface (HDMI: registered trademark) cable4. The reproduction device 2 and the display device 3 may be connectedvia a cable of another standard or may be connected via wirelesscommunication.

The recording device 1 records content and the reproduction device 2reproduces the content. Supply of the content from the recording device1 to the reproduction device 2 is performed using an optical disc 11.The optical disc 11 is, for example, a disc on which content is recordedin a Blu-ray (registered trademark) Disc Read-Only (BD-ROM) format.

The recording of content on the optical disc 11 may be performed inanother format such as BD-R or -RE. The supply of content from therecording device 1 to the reproduction device 2 may also be performedusing a removable medium other than the optical disc, such as a memorycard on which a flash memory is mounted, or may also be performedthrough network delivery.

When the optical disc 11 is a BD-ROM disc, the recording device 1 is,for example, a device used by a content author. The optical disc 11 onwhich the content is recorded by the recording device 1 will beappropriately assumed to be supplied to the reproduction device 2 in thefollowing description. However, in practice, optical discs are copiedbased on a master record on which the content is recorded by therecording device 1 and the optical disc 11 which is one of the opticaldiscs is supplied to the reproduction device 2.

At least one High Dynamic Range (HDR) video which is a video having adynamic range equal to or greater than a dynamic range (luminance range)displayable on a monitor of standard luminance is input to the recordingdevice 1. The standard luminance is, for example, 100 cd/m² (=100 nits).

HDR graphics which are graphics having a dynamic range equal to orgreater than a dynamic range displayable on a monitor of standardluminance are input to the recording device 1. Hereinafter, when it isnot necessary to distinguish the HDR video from the HDR graphics, theHDR video and the HDR graphics are collectively referred to as HDR data.

The recording device 1 encodes input master HDR data without conversion,that is, encodes data having a dynamic range equal to or greater than adynamic range displayable on a monitor of standard luminance, andrecords the master HDR data on the optical disc 11 with a BD format.

In this case, HDR information indicating luminance characteristics ofthe master HDR data and low-conversion information used when the HDRdata is converted into STD data are also recorded on the optical disc11.

The STD data is a general term of STD video (standard video) which is avideo having a dynamic range displayable on a monitor of standardluminance, and STD graphics which are graphics having the dynamic range.When the dynamic range of the STD data is a range of 0% to 100%, thedynamic range of the HDR data is expressed as a range of 0% to 101% ormore, such as a range of 0% to 500% or a range of 0% to 1000%.

The recording device 1 converts the input master HDR data into the STDdata, that is, converts the HDR data into data having a dynamic rangedisplayable on a monitor of standard luminance, encodes the data, andrecords the data on the optical disc 11 with the BD format. In thiscase, the HDR information and high-conversion information used when theSTD data is converted into the HDR data are also recorded on the opticaldisc 11.

An HDR video recorded by the recording device 1 or an STD video obtainedby converting the HDR video is, for example, a video having a so-called4K resolution such as a horizontal×vertical resolution of 4096×2160 or3840×2160 pixels. As a video encoding scheme, for example, a HighEfficiency Video Coding (HEVC) scheme is used.

In the HEVC scheme, information indicating the luminance characteristicsof data of an HDR image and information used when the data of the HDRimage is converted into data of an STD image or conversion of the dataof the STD image into the data of the HDR image can be set insupplemental enhancement information (SEI). Accordingly, the HDRinformation and the low-conversion information or the high-conversioninformation is set and recorded in the SEI of a video stream which is anHEVC stream of a video. As a subtitle encoding scheme, there is arun-length scheme.

The reproduction device 2 communicates with the display device 3 via theHDMI cable 4 to acquire information regarding display performance of thedisplay device 3. The reproduction device 2 specifies that the displaydevice 3 is a device including an HDR monitor which is a monitor capableof displaying HDR data or a device including an STD monitor which is amonitor capable of displaying only STD data.

The reproduction device 2 activates a drive and reads a graphics streamwhich is a stream obtained by encoding graphics and a video streamrecorded on the optical disc 11 to perform decoding.

For example, when the data obtained through the decoding is HDR data andthe display device 3 includes the HDR monitor, the reproduction device 2outputs the HDR data obtained through the decoding to the display device3. In this case, the reproduction device 2 outputs the HDR informationto the display device 3 along with the HDR data.

On the other hand, when the data obtained through the decoding is theHDR data and the display device 3 includes the STD monitor, thereproduction device 2 converts the HDR data obtained through thedecoding into STD data and outputs the STD data. The conversion of theHDR data into the STD data is performed using the low-conversioninformation recorded on the optical disc 11.

When the data obtained through the decoding is STD data and the displaydevice 3 includes the HDR monitor, the reproduction device 2 convertsthe STD data obtained through the decoding into HDR data and outputs theHDR data to the display device 3. The conversion of the STD data intothe HDR data is performed using the high-conversion information recordedon the optical disc 11. In this case, the reproduction device 2 outputsthe HDR information to the display device 3 along with the HDR data.

On the other hand, when the data obtained through the decoding is STDdata and the display device 3 includes the STD monitor, the reproductiondevice 2 outputs the STD data obtained through the decoding to thedisplay device 3.

The display device 3 receives the STD data or the HDR data transmittedfrom the reproduction device 2 and displays a video on the monitor basedon the STD data or the HDR data.

For example, when the HDR information is transmitted, the display device3 recognizes that the data transmitted along with the HDR informationfrom the reproduction device 2 is the HDR data. As described above, theHDR information is transmitted along with the HDR data to the displaydevice 3 including the HDR monitor.

In this case, the display device 3 displays the video of the HDR dataaccording to characteristics designated by the HDR information. That is,when the monitor of the display device 3 is a monitor having a dynamicrange of 0% to 500% and the dynamic range of the HDR data is designatedas predetermined characteristics of 0% to 500% by the HDR information,the display device 3 adjusts luminance in the range of 0% to 500%according to the predetermined characteristics and displays the video.

When the luminance characteristics of the master HDR data are configuredto be designated, a content author can display a video with intendedluminance.

In general, a display device such as a TV recognizes data input from theoutside as data having a dynamic range of 0% to 100%. When the monitorof the display device has a broader dynamic range than the dynamic rangeof 0% to 100%, the display device expands luminance according to thecharacteristics of the monitor by itself and displays the video. Bydesignating the luminance characteristics and adjusting the luminance ofthe HDR data according to the designated characteristics, it is possibleto prevent luminance adjustment not intended by the author from beingperformed on the display device side.

In general, a reproduction device outputting data to a display devicesuch as a TV converts luminance according to characteristics of atransmission path, and then outputs data. A display device receiving thedata converts the luminance of the received data according tocharacteristics of a monitor and displays a video. By outputting the HDRdata from the reproduction device 2 to the display device 3 withoutperforming the conversion of the luminance in the reproduction device 2,it is possible to reduce a number of times the luminance is converted,and thus a video having luminance closer to the master can be displayedon the display device 3.

On the other hand, when the HDR information is not transmitted, thedisplay device 3 recognizes that the data transmitted from thereproduction device 2 is the STD data and displays the video of the STDdata. The fact that the STD data is transmitted from the reproductiondevice 2 means that the display device 3 is a device that includes theSTD monitor.

When audio data is recorded on the optical disc 11 by the recordingdevice 1, the audio data is also transmitted from the reproductiondevice 2. The display device 3 outputs audio from a speaker based on theaudio data transmitted from the reproduction device 2.

Hereinafter, a mode in which the master HDR data is recorded on theoptical disc 11 without conversion is appropriately referred to asmode-i. In the case of mode-i, the HDR information and thelow-conversion information are recorded on the optical disc 11.

Further, a mode in which the master HDR data is converted into the STDdata and is recorded on the optical disc 11 is referred to as mode-ii.In the case of mode-ii, the HDR information and the high-conversioninformation are recorded on the optical disc 11.

(Signal Processing in Mode-i)

FIG. 2 is a diagram illustrating an example of signal processing inmode-i.

A process on the left side indicated by a solid line L1 is an encodingprocess performed in the recording device 1 and a process on the rightside indicated by a solid line L2 is a decoding process performed in thereproduction device 2.

When the master HDR data is input, the recording device 1 detects theluminance of the master HDR data and generates the HDR information asindicated by the tip of arrow #1. The recording device 1 encodes themaster HDR video in accordance with the HEVC scheme to generate codeddata, as indicated by the tip of arrow #2-1 and encodes master HDRgraphics to generate a graphics stream, as indicated by the tip of arrow#2-2.

The recording device 1 converts the master HDR data into the STD data,as indicated by the tip of arrow #3. A video of the STD data obtainedthrough the conversion is displayed on a monitor (not illustrated). Theconversion of the HDR data into the STD data is performed appropriatelywhile the author confirms the video of the STD after the conversion withhis or her eyes and adjusts a conversion parameter.

Based on the adjustment by the author, the recording device 1 generatestone mapping definition information for HDR-STD conversion which islow-conversion information, as indicated by the tip of arrow #4.

The tone mapping definition information is information defining acorrespondence relation between each luminance value in a dynamic rangesuch as a range of 0% to 400% broader than a standard dynamic range andeach luminance value in a dynamic range such as a range of 0% to 100%which is the standard dynamic range.

As indicated by the tip of arrow #5, the recording device 1 inserts theHDR information and the tone mapping definition information as the SEIinto encoded data of the HDR video to generate a video stream. Therecording device 1 records the generated video stream and a graphicsstream of the HDR graphics on the optical disc 11 in accordance with theBD format and supplies the optical disc 11 to the reproduction device 2,as indicated by arrow #11.

In this way, the HDR video, the HDR information of the HDR graphics, andthe tone mapping definition information for the HDR-STD conversion aresupplied using the SEI to the reproduction device 2 in the form insertedinto the video stream.

The reproduction device 2 reads the graphics stream from the opticaldisc 11 and decodes the graphics stream, as indicated by the tip ofarrow #20, to generate the HDR graphics.

The reproduction device 2 reads the video stream from the optical disc11 and extracts the HDR information and the tone mapping definitioninformation from the SEI of the video stream, as indicated by the tipsof arrows #21 and #22.

As indicated by the tip of arrow #23, the reproduction device 2 decodesthe encoded data included in the video stream in accordance with theHEVC scheme to generate the HDR video. When the display device 3includes the HDR monitor, the reproduction device 2 adds the HDRinformation to the HDR data obtained through the decoding, as indicatedby the tip of arrow #24, and outputs the HDR data to the display device3, as indicated by the tip of arrow #25.

On the other hand, when the display device 3 includes the STD monitor,the reproduction device 2 converts the HDR data obtained through thedecoding into the STD data using the tone mapping definition informationfor the HDR-STD conversion extracted from the video stream, as indicatedby the tip of arrow #26. The reproduction device 2 outputs the STD dataobtained through the conversion to the display device 3, as indicated bythe tip of arrow #27.

In this way, the HDR data obtained through the decoding is output to thedisplay device 3 including the HDR monitor along with the HDRinformation. The HDR data obtained through the decoding is output to thedisplay device 3 including the STD monitor after the HDR data isconverted into the STD data.

FIG. 3 is a diagram illustrating the flow of a process from input of themaster HDR data to the recording device 1 to output of the data from thereproduction device 2.

As indicated by the tip of white arrow #51, the master HDR data issupplied to the reproduction device 2 along with the tone mappingdefinition information for the HDR-STD conversion and the HDRinformation generated by the recording device 1 based on the master HDRdata. The HDR information includes information indicating that thedynamic range is expanded to, for example, the range of 0% to 400%.

When the display device 3 includes the HDR monitor, the HDR informationis added to the HDR data obtained through the decoding, as indicated bythe tips of arrows #52 and #53 in the reproduction device 2. The HDRdata to which the HDR information is added is output to the displaydevice 3, as indicated by the tip of arrow #54.

On the other hand, when the display device 3 includes the STD monitor,the HDR data obtained through the decoding is converted into the STDdata using the tone mapping definition information for the HDR-STDconversion, as indicated by the tips of arrows #55 and #56, in thereproduction device 2. The STD data obtained through the conversion isoutput to the display device 3, as indicated by the tip of arrow #57. InFIG. 3, each of the amplitude of a waveform indicating the HDR data andthe amplitude of a waveform indicating the STD data indicates a dynamicrange.

In this way, in mode-i, the master HDR data is recorded as the HDR datawithout conversion on the optical disc 11. According to the performanceof the display device 3 which is an output destination, switching isperformed between the addition of the HDR information and the output ofthe HDR data obtained through the decoding without conversion, and theconversion of the HDR data into the STD data and the output of the STDdata.

(Signal Processing in Mode-ii)

FIG. 4 is a diagram illustrating an example of signal processing inmode-ii.

When the master HDR data is input, the recording device 1 detects theluminance of the master HDR data and generates the HDR information, asindicated by the tip of arrow #71.

The recording device 1 converts the master HDR data into the STD data,as indicated by the tip of arrow #72. The video of the STD data obtainedthrough the conversion is displayed on the monitor (not illustrated).

Based on the adjustment by the author, the recording device 1 generatestone mapping definition information for STD-HDR conversion which ishigh-conversion information, as indicated by the tip of arrow #73.

As indicated by the tip of arrow #74-1, the recording device 1 encodesthe STD video obtained by converting the master HDR video in accordancewith the HEVC scheme to generate encoded data. As indicated by the tipof arrow #74-2, the recording device 1 encodes the STD graphics obtainedby converting the master HDR graphics to generate a graphics stream.

As indicated by the tip of arrow #75, the recording device 1 inserts theHDR information and the tone mapping definition information as the SEIinto encoded data to generate a video stream. The recording device 1records the generated video stream and a graphics stream on the opticaldisc 11 in accordance with the BD format and supplies the optical disc11 to the reproduction device 2, as indicated by arrow #91.

The reproduction device 2 reads the video stream from the optical disc11 and extracts the HDR information and the tone mapping definitioninformation from the SEI of the video stream, as indicated by the tipsof arrows #101 and #102.

The reproduction device 2 decodes the encoded data included in the videostream in accordance with the HEVC scheme to generate the STD video, asindicated by the tip of arrow #103-1, and decodes the graphics stream togenerate the STD graphics, as indicated by the tip of arrow #103-2. Whenthe display device 3 includes the STD monitor, the reproduction device 2outputs the STD data obtained through the decoding to the display device3, as indicated by the tip of arrow #104.

On the other hand, when the display device 3 includes the HDR monitor,the reproduction device 2 converts the STD data obtained through thedecoding into the HDR data using the tone mapping definition informationfor the STD-HDR conversion extracted from the video stream, as indicatedby the tip of arrow #105. The reproduction device 2 adds the HDRinformation to the HDR data obtained through the conversion, asindicated by the tip of arrow #106, and outputs the HDR data to thedisplay device 3, as indicated by the tip of arrow #107.

In this way, after the STD data obtained through the decoding isconverted into the HDR data, the HDR data is output to the displaydevice 3 including the HDR monitor along with the HDR information. TheSTD data obtained through the decoding is output to the display device 3including the STD monitor without conversion.

FIG. 5 is a diagram illustrating the flow of a process from input of themaster HDR data to the recording device 1 to output of the data from thereproduction device 2.

As indicated by the tip of white arrow #121, after the master HDR datais converted into the STD data, the STD data is supplied to thereproduction device 2 along with the tone mapping definition informationfor the STD-HDR conversion and the HDR information generated in therecording device 1 based on the master HDR data.

When the display device 3 includes the HDR monitor, the STD dataobtained through the decoding is converted into the HDR data using thetone mapping definition information for the STD-HDR conversion, asindicated by the tips of arrows #122 and #123 in the reproduction device2. The HDR data obtained by converting the STD data is added to the HDRinformation, as indicated by the tips of arrows #124 and #125, and theHDR data is output to the display device 3, as indicated by the tip ofarrow #126.

On the other hand, when the display device 3 includes the STD monitor,the STD data obtained through the decoding is output to the displaydevice 3, as indicated by the tip of arrow #127, in the reproductiondevice 2.

In this way, in mode-ii, the master HDR data is converted into the STDdata to be recorded on the optical disc 11. According to the performanceof the display device 3 which is an output destination, switching isperformed between the conversion of the STD data obtained through thedecoding into the HDR data and the addition and output of the HDRinformation, and the output of the STD data without conversion.

The details of the configurations and operations of the recording device1 and the reproduction device 2 described above will be described below.

Here, the HEVC scheme will be described.

(Configuration of Access Unit in HEVC Scheme)

FIG. 6 is a diagram illustrating the configuration of an access unit inthe HEVC scheme.

A video stream is configured to include an access unit which is acollection of network abstraction layer (NAL) units. One access unitincludes video data of one picture.

As illustrated in FIG. 6, one access unit is configured to include anaccess unit delimiter (AU delimiter), a video parameter set (VPS), asequence parameter set (SPS), a picture parameter set (PPS), an SEI, avideo coding layer (VCL), an end of sequence (EOS), and an end of stream(EOS).

The AU delimiter indicates the beginning of an access unit. The VPSincludes metadata indicating the content of a bit stream. The SPSincludes information, such as a picture size and a coding tree block(CTB) size, which is necessarily referred to in a decoding process for asequence by an HEVC decoder. The PPS includes information which isnecessarily referred to by the HEVC decoder in order to perform adecoding process for a picture. The VPS, the SPS, and the PPS are usedas header information.

The SEI is auxiliary information that includes timing information ofeach picture or information regarding random access. The HDR informationand the tone mapping definition information are included intone_mapping_info which is one of the SEIs. Identification informationidentifying tone_mapping_info is assigned to tone_mapping_info. In thepresent specification, tone_mapping_info in which the identificationinformation is i is referred to as tone_mapping_info #i.

The VCL is encoded data of 1 picture. The end of sequence (EOS)indicates an end position of a sequence and the end of stream (EOS)indicates an end position of a stream.

(Tone_Mapping_Info)

FIG. 7 is a diagram illustrating the syntax of tone_mapping_info.

The brightness or color of a video obtained by performing decoding usingtone_mapping_info is converted according to the performance of a monitorwhich is a video output destination. A line number and a colon (:) onthe left side of FIG. 7 are shown for convenience of the description andare not included in the syntax. The same also applies to FIGS. 16 to 18,20, 37, 38, 50, and 51 to be described below. Main information includedin tone_mapping_info will be described.

In the 2nd line, tone_map_id is identification information oftone_mapping_info. In the 8th line, tone_map_model_id indicates a modelof a tone map used for conversion.

In the recording device 1, at least one piece of tone_mapping_info inwhich one value among 0, 2, and 3 is set as tone_map_model_id and onepiece of tone_mapping_info in which a value of 4 is set astone_map_model_id are generated.

As illustrated in FIG. 8, tone_mapping_info in which one value among 0,2 and 3 is set as tone_map_model_id is used as the tone mappingdefinition information for HDR-STD conversion or STD-HDR conversion.Information included in tone_mapping_info in which a value of 4 is setas tone_map_model_id is used as the HDR information.

In FIG. 7, 9th to 11th lines are a description of tone_map_model_id=0.In the case of tone_map_model_id=0, min_value and max_value aredescribed.

FIG. 9 is a diagram illustrating an example of a tone curve shown bytone_mapping_info of tone_map_model_id=0.

In FIG. 9, the horizontal axis represents coded_data (RGB value beforeconversion) and the vertical axis represents target_data (RGB valueafter conversion). When the tone curve in FIG. 9 is used, an RGB valueequal to or less than D1 is converted into an RGB value indicated bymin_value, as indicated by white arrow #151. Further, an RGB value equalto or greater than D2 is converted into an RGB value indicated bymax_value, as indicated by white arrow #152.

Here, tone_mapping_info of tone_map_model_id=0 is used as the tonemapping definition information for HDR-STD conversion. Whentone_mapping_info of tone_map_model_id=0 is used, luminance equal to orgreater than max_value and equal to or less than min_value (luminanceexpressed by an RGB value) is lost, but a load on the conversion processis lightened.

In FIG. 7, 15th to 17th lines are a description of tone_map_model_id=2.In the case of tone_map_model_id=2, start_of_coded_interval[i] of thesame number as the number of pieces of max_target_data, which indicatesa step function, is described. The number of bits ofstart_of_coded_interval[i] may be a variable value decided bycoded_data_bit_depth in the 6th line or a fixed value (256 bits). In thecase of the variable value, the number of bits can be reduced to be lessthan the fixed value.

FIG. 10 is a diagram illustrating an example of a step function shown bytone_mapping_info of tone_map_model_id=2.

When the step function in FIG. 10 is used, for example, coded_data=5 isconverted into target_data=3. When start_of_coded_interval[i] is assumedto be {1, 3, 4, 5, 5, 5, 7, 7, . . . }, a coded_data-target-dataconversion table is expressed as {0, 1, 1, 2, 3, 5, 5, . . . }.

Here, tone_mapping_info of tone_map_model_id=2 is used as the tonemapping definition information for STD-HDR conversion or HDR-STDconversion. Further, since tone_mapping_info of tone_map_model_id=2 hasa large amount of data, it is necessary to perform convolution to aconversion table at the time of generation, but a load of the conversionprocess is light.

In FIG. 7, 18th to 23rd lines are a description of tone_map_model_id=3.In the case of tone_map_model_id=3, coded_pivot_value[i] andtarget_pivot_value[i] of numbers designated by num_pivots, whichindicate a polygonal line function, are described. The number of bits ofcoded_pivot_value[i] and target_pivot_value[i] may be a variable valuedecided by coded_data_bit_depth in the 6th line or may be a fixed value(256 bits). In the case of the variable value, the number of bits can bereduced to be less than the fixed value.

FIG. 11 is a diagram illustrating an example of a polygonal linefunction shown by tone_mapping_info of tone_map_model_id=3.

When the polygonal line function in FIG. 11 is used, for example,coded_data=D11 is converted into target_data=D11′ and coded_data=D12 isconverted into target_data=D12′. Here, tone_mapping_info oftone_map_model_id=3 is used as the tone mapping definition informationfor STD-HDR conversion or HDR-STD conversion.

In this way, tone_mapping_info in which one value among 0, 2, and 3 isset as tone_map_model_id is used as the tone mapping definitioninformation for STD-HDR conversion or HDR-STD conversion and istransmitted from the recording device 1 to the reproduction device 2.

In FIG. 7, 24th to 39th lines are a description of tone_map_model_id=4.Of the information regarding tone_map_model_id=4,ref_screen_luminance_white, extended_range_white_level,nominal_black_level_code_value, nominal_white_level_code_value, andextended_white_level_code_value are parameters included in the HDRinformation.

FIG. 12 is a diagram illustrating an example of each piece ofinformation included in the HDR information.

In FIG. 12, the horizontal axis represents a luminance value. When a bitlength is 10 bits, the luminance value is a value of 0 to 1023. In FIG.12, the vertical axis represents brightness. A curved line L11 indicatesa relation between a luminance value and brightness in a monitor havingstandard luminance. A dynamic range of the monitor having the standardluminance is a range of 0% to 100%.

Here, ref_screen_luminance_white indicates the brightness (cd/m²) of astandard monitor. Further, extended_range_white_level indicates thebrightness of a dynamic range after extension. In the case of theexample of FIG. 12, 400 is set as a value of extended_range_white_level.

Here, nominal_black_level_code_value indicates a luminance value ofblack (brightness of 0%) and nominal_white_level_code_value indicates aluminance value of white (brightness of 100%) in the monitor having thestandard luminance. Further, extended_white_level_code_value indicates aluminance value of white in the dynamic range after extension.

In the case of the example of FIG. 12, the dynamic range of 0% to 100%is extended to a dynamic range of 0% to 400% according to the value ofextended_range_white_level, as indicated by white arrow #161. Aluminance value corresponding to brightness of 400% is designated byextended_white_level_code_value.

The luminance characteristics of the HDR data are characteristicsindicated by a curved line L12 in which the values ofnominal_black_level_code_value, nominal_white_level_code_value, andextended_white_level_code_value are respectively brightness of 0%, 100%,and 400%.

In this way, the luminance characteristics of the master HDR data areindicated by tone_mapping_info in which the value of 4 is set astone_map_model_id and is transmitted from the recording device 1 to thereproduction device 2.

Here, the BD-ROM format will be described.

(Management Structure of AV Stream in BD-ROM Format)

FIG. 13 is a diagram illustrating an example of a management structureof an AV stream in a BD-ROM format.

The management of an AV stream including a video stream is performedusing two layers of PlayList and Clip. The AV stream is recorded notonly on the optical disc 11 but also on a local storage of thereproduction device 2.

A pair of one AV stream and Clip Information which is informationpertaining to the AV stream is managed as one object. A pair of AVstream and Clip Information is referred to as Clip.

The AV stream is developed on a time axis and an access point of eachClip is designated in PlayList mainly with a time stamp. ClipInformation is used, for example, to search for an address at whichdecoding is to start, in the AV stream.

PlayList is a collection of reproduction sections of an AV stream. Onereproduction section in the AV stream is referred to as PlayItem.PlayItem is expressed with a pair of IN point and OUT point of areproduction section on the time axis. As illustrated in FIG. 13,PlayList is configured to include one PlayItem or a plurality ofPlayItems.

The first PlayList from the left side of FIG. 13 is configured toinclude two PlayItems. The first half portion and the second halfportion of the AV stream included in the left Clip are referred to bythe two PlayItems.

The second PlayList from the left side is configured to include onePlayItem and the entire AV stream included in the right Clip is referredto by the PlayList.

The third PlayList from the left side is configured to include twoPlayItems. A certain portion of the AV stream included in the left Clipand a certain portion of the AV stream included in the right Clip arereferred to by the two PlayItems.

For example, the left PlayItem included in the first PlayList from theleft side is designated as a reproduction target by a disc navigationprogram, the first half portion of the AV stream included in the leftClip referred to by the PlayItem is reproduced. In this way, PlayList isused as reproduction management information to manage reproduction ofthe AV stream.

A reproduction path which is a reproduction path of at least onePlayList in PlayList and is made in accordance with at least the onePlayList is referred to as Main Path. A reproduction path which is areproduction path of at least one SubPlayItem in PlayList and is made inaccordance with at least the one SubPlayItem in parallel with Main Pathis referred to as Sub Path.

(Structure of Main Path and Sub Path)

FIG. 14 is a diagram illustrating the structure of Main Path and SubPath.

PlayList includes one Main Path and at least one Sub Path. PlayList inFIG. 14 includes one Main Path and three Sub Paths which are Main Pathand Sub Paths of three PlayItems and are made in accordance with thethree PlayItems.

In PlayItems forming Main Path, IDs are each set sequentially from thebeginning. In Sub Paths, IDs of Subpath_id=0, Subpath_id=1, andSubpath_id=2 are set sequentially from the beginning.

In the example of FIG. 14, one SubPlayItem is included in Sub Path ofSubpath_id=0 and two SubPlayItems are included in Sub Path ofSubpath_id=1. One SubPlayItem is included in Sub Path of Subpath_id=2.

An AV stream referred to by one PlayItem includes at least a videostream of a main video. The AV stream may include or may not include atleast one audio stream reproduced at the same timing as (synchronizedwith) the video stream of the main video included in the AV stream.

The AV stream may include or may not include at least one video streamof a sub-video reproduced in synchronization with the video stream ofthe main video included in the AV stream.

The AV stream may include or may not include at least one PG streamwhich is a stream of subtitle data (Presentation Graphic (PG)) of a bitmap reproduced in synchronization with the video stream of the mainvideo included in the AV stream.

The AV stream may include or may not include at least one Text_ST streamwhich is a stream of text data (Text-ST) of subtitles reproduced insynchronization with the video stream of the main video included in theAV stream.

The AV stream may include or may not include at least one IG streamwhich is a stream of image data (Interactive Graphic (IG)) of a menubutton reproduced in synchronization with the video stream of the mainvideo included in the AV stream.

The video stream of the main video, and the audio stream, the videostream of the sub-video, the PG stream, the Text-ST stream, and the IGstream reproduced in synchronization with the video stream of the mainvideo are multiplexed to the AV stream referred to by one PlayItem.

One SubPlayItem refers to, for example, a video stream, an audio stream,a PG stream, a Text-ST stream, an IG stream, or the like different fromthe AV stream referred to by PlayItem.

In this way, the AV stream is reproduced using PlayList and ClipInformation. PlayList and Clip Information including the informationregarding the reproduction of the AV stream are appropriately referredto as Data Base information.

(Management Structure of File of Optical Disc 11)

FIG. 15 is a diagram illustrating an example of a management structureof a file recorded on the optical disc 11.

Each file recorded on the optical disc 11 is hierarchically managed by adirectory structure. One root directory is created on the optical disc11.

A BDMV directory is placed under the root directory.

Under the BDMV directory, an Index file which is a file in which a name“Index.bdmv” is set and a MovieOjbect file which is a file in which aname “MovieObject.bdmv” are set.

In the Index file, for example, a list of title numbers recorded on theoptical disc 11, and kinds of objects and object numbers executed incorrespondence to the title numbers are described. As the kinds ofobjects, there are two kinds of a movie object (MovieObject) and a BDJobject (BDJ object).

The movie object is an object in which a navigation command ofreproduction or the like of a playlist is described. The BDJ object isan object in which a BDJ application is described. In a MovieObjectfile, a movie object is described.

Under the BDMV directory, a PLAYLIST directory, a CLIPINF directory, aSTREAM directory, a BDJO directory, and the like are provided.

In the PLAYLIST directory, PlayList files in which PlayList is describedare stored. In each PlayList file, a name in which a 5-digit number andan extension “.mpls” are combined is set. In one Playlist fileillustrated in FIG. 15, a file name “00000.mpls” is set.

In the CLIPINF directory, Clip Information files in which ClipInformation is described are stored. In each Clip Information file, aname in which a 5-digit number and an extension “.clpi” are combined isset. In three Clip Information files in FIG. 15, file names“00001.clpi,” “00002.clpi,” and “00003.clpi” are set.

In the STREAM directory, stream files are stored. In each stream file, aname in which a 5-digit number and an extension “.m2ts” are combined isset. In three stream files in FIG. 15, file names “00001.m2ts,”“00002.m2ts,” and “00003.m2ts” are set.

The Clip Information file and the stream file in which the same 5-digitnumber is set in the file name are files forming one Clip. When thestream file “00001.m2ts” is reproduced, the Clip Information file“00001.clpi” is used. When the stream file “00002.m2ts” is reproduced,the Clip Information file “00002.clpi” is used.

In the BDJO directory, BDJ object files in which a BDJ object isdescribed are stored. In each BDJ object file, a name in which a 5-digitnumber and an extension “.bdjo” are combined is set. In three streamfiles in FIG. 15, file names “00001.bdjo,” “00002.bdjo,” and“00003.bdjo” are set.

Here, main description of the syntax of each file will be described.

(Syntax of Playlist File)

FIG. 16 is a diagram illustrating the syntax of STN_table of PlayItem ofa playlist file.

STN_table includes information regarding the AV stream referred to byPlayItem. When there is Sub Path reproduced in association withPlayItem, information regarding the AV stream referred by SubPlayItemforming the Sub Path.

In the 4th line, number_of_primary_video_stream_entries indicates thenumber of video streams of a main video entered (registered) inSTN_table. In the 6th line, number_of_PG_textST_stream_entries indicatesthe number of PG streams and Text-ST streams entered in STN_table. Inthe 7th line, number_of_IG_stream_entries indicates the number of IGstreams entered in STN_table.

In the 11th line, primary_video_tone_mapping_flag indicates whether thevideo stream of the main video and tone_mapping_info are associated witheach other. In the 12th line, PG_text_ST_tone_mapping_flag indicateswhether the PG stream, the Text-ST stream, and tone_mapping_info areassociated with one another. In the 13th line, IG_tone_mapping_flagindicates whether the IG stream and tone_mapping_info are associatedwith each other. In the 14th line, secondary_video_tone_mapping_flagindicates whether the video stream of the sub-video andtone_mapping_info are associated with each other.

As illustrated in the 33rd line, when primary_video_tone_mapping_flag is1, number_of_tone_mapping_info_ref indicating the number of pieces oftone_mapping_info used when the video stream of the main video isreproduced is described in STN_table.

As illustrated in the 34th to 37th lines, whenprimary_video_tone_mapping_flag is 1, tone_mapping_info_ref indicatingtone_map_id of tone_mapping_info used when the video stream of the mainvideo is reproduced is described in STN_table. Thus, the video stream ofthe main video and tone_mapping_info of the video stream are associatedwith each other. Accordingly, number_of_tone_mapping_info_ref andtone_mapping_info_ref in the 33rd to 37th lines are associationinformation associating the video stream of the main video withtone_mapping_info of the video stream of the main video.

Similarly, as illustrated in the 56th to 60th lines, whenPG_text_ST_tone_mapping_flag is 1, the number of pieces oftone_mapping_info used when the PG stream and the Text-ST stream arereproduced and tone_map_id of tone_mapping_info are set in STN_table.Thus, the PG stream and the Text-ST stream are associated withtone_mapping_info of the PG stream and the Text-ST stream. Accordingly,number_of_tone_mapping_info_ref and tone_mapping_info_ref in the 56th to60th lines are association information associating the PG stream and theText-ST stream with tone_mapping_info of the PG stream and the Text-STstream.

Similarly, as illustrated in the 79th to 83rd lines, whenIG_tone_mapping_flag is 1, the number of pieces of tone_mapping_infoused when the IG stream is reproduced and tone_map_id oftone_mapping_info are set in STN_table. Thus, the IG stream andtone_mapping_info of the IG stream are associated with each other.Accordingly, number_of_tone_mapping_info_ref and tone_mapping_info_refin the 79th to 83rd lines are association information associating the IGstream with tone_mapping_info of the IG stream. Similarly, asillustrated in the 105th to 109th lines, whensecondary_video_tone_mapping_flag is 1, the number of pieces oftone_mapping_info used when the video stream of the sub-video isreproduced and tone_map_id of tone_mapping_info are set in STN_table.Thus, the video stream of the sub-video and tone_mapping_info of thevideo stream of the sub-video are associated with each other.Accordingly, number_of_tone_mapping_info_ref and tone_mapping_info_refin the 105th to 109th lines are association information associating thevideo stream of the sub-path with tone_mapping_info of the video streamof the sub-video.

As described above, each AV stream and tone_mapping_info of the AVstream are associated with each other in STN table. Accordingly, thereproduction device 2 can select tone_mapping_info of each AV stream intone_mapping_info inserted into the SEI of the video stream based onSTN_table and use tone_mapping_info when the AV stream is reproduced.

(Syntax of Clip Information File)

FIG. 17 is a diagram illustrating the syntax of StreamCodingInfo of aClip Information file.

StreamCodingInfo includes information regarding encoding of the AVstream included in Clip.

In the 3rd line, stream_coding_type indicates an encoding scheme of anelementary stream included in the AV stream. For example, inStreamCodingInfo of Clip Information used when the video stream isreproduced, a value indicating that the encoding scheme is the HEVCscheme is set as stream_coding_type.

As illustrated in the 4th to 6th lines, StreamCodingInfo includes [VideoBlock] which is information regarding encoding of the video stream,[Audio Block] which is encoding of an audio stream, and [Graphics Block]which is information regarding encoding of a graphics stream.

FIG. 18 is a diagram illustrating the syntaxes of [Video Block] and[Graphics Block] in FIG. 17.

FIG. 18A illustrates the syntax of [Video Block] and FIG. 18Billustrates the syntax of [Graphics Block].

[Video Block] in FIG. 18A is information regarding encoding of the videostream described in StreamCodingInfo of Clip Information used inreproduction of the video stream. In the 5th line, video_formatindicates a video scanning scheme.

In the 10th line, HDR_flag is a 1-bit flag and indicates whether the HDRdata is recorded as a master. For example, HDR_flag=1 indicates that theHDR data is recorded as a master. Further, HDR_flag=0 indicates that theSTD data is recorded as a master.

In the 11th line, mode_flag is a 1-bit flag and indicates a recordingmode of the AV stream. Further, mode_flag is effective in the case ofHDR_flag=1. For example, mode_flag=1 indicates that the recording modeis mode-i. Further, mode_flag=0 indicates that the recording mode ismode-ii.

In this way, Clip Information includes the flag indicating whether theAV stream reproduced using Clip Information is a stream in which amaster of the AV stream is master HDR data and the flag indicating therecording mode of the AV stream.

The reproduction device 2 can specify, for example whether the masterdata is the HDR data without actual analysis of the AV stream byreferring to the flag included in Clip Information.

In the 14th line, number_of_tone_mapping_info_ref indicates the numberof pieces of tone_mapping_info included in the video stream. Asillustrated in the 15th to 18th lines, [Video Block] also includestone_mapping_info_ref indicating tone_map_id of tone_mapping_infoincluded in the video stream.

[Graphics Block] in FIG. 18B is information regarding encoding of thegraphics stream described in StreamCodingInfo of Clip Information usedin reproduction of the graphics stream. As illustrated in the 4th line,when the graphics stream is the PG stream, [Graphics Block] includesPG_language_code indicating a language code of the PG stream.

As illustrated in the 7th to 11th lines, when the graphics stream is thePG stream, [Graphics Block] includes number_of_tone_mapping_info_refindicating the number of pieces of tone_mapping_info included in the PGstream and tone_mapping_info_ref indicating tone_map_id oftone_mapping_info.

When the graphics stream is the IG stream, as illustrated in the 15thline, [Graphics Block] also include IG_language_code indicating alanguage code of the IG stream. As illustrated in the 18th to 22ndlines, number_of_tone_mapping_info_ref indicating the number of piecesof tone_mapping_info included in the IG stream and tone_mapping_info_refindicating tone_map_id of tone_mapping_info are included.

Here, the configurations of the PG stream and the IG stream will bedescribed.

(Configurations of PG Stream and IG Stream)

FIG. 19 is a diagram illustrating a configuration example of a displayset of a PG stream and an IG stream.

As illustrated in FIG. 19A, a display set of the PG stream is configuredto include a presentation composition segment (PCS), a window definitionsegment (WDS), an extended palette definition segment (XPDS), an objectdefinition segment (ODS), and an end of display set segment (END) whichare segments of subtitles corresponding to one screen.

In the PCS, an ID or the like assigned to the subtitles corresponding toeach ODS is described. In the WDS, information or the like indicating astructure such as the position, size, or the like of a window indicatinga subtitles display range is described. In the XPDS, informationregarding colors which can be used as colors of subtitles is described.In the ODS, information indicating the shape of the subtitles isdescribed. The END is a segment indicating the end of the display set.

As illustrated in FIG. 19B, a display set of the IG stream is configuredto include an interactive composition segment (ICS), an XPDS, an ODS,and an END which are segments of a menu button corresponding to onescreen.

In the ICS, a command executed by a manipulation of the menu button andan ID or the like unique to the menu button corresponding to each ODSare described. In the XPDS, information regarding colors which can beused as colors of the menu button is described. In the ODS, informationindicating the shape of the menu button is described. The END is asegment indicating the end of the display set.

(Syntax of XPDS)

FIG. 20 is a diagram illustrating the syntax of the XPDS.

In the 5th line of FIG. 20, color_depth indicates the number of bits ofY_value, Cr_value, Cb_value, and T_value in the 9th to 12th lines.Y_value indicates a luminance component of a color, Cr_value andCb_value indicate a color difference component of the color, and T_valueindicates transparency of the color.

In the Text-ST stream, although not illustrated, color_depth isdescribed in a dialog style segment (DSS).

Here, the configuration of each device will be described.

(Configuration of Recording Device 1)

FIG. 21 is a block diagram illustrating a configuration example of therecording device 1.

The recording device 1 is configured to include a controller 21, anencoding processing unit 22, and a disc drive 23. The master HDR data isinput to the encoding processing unit 22.

The controller 21 is configured to include a central processing unit(CPU), a read-only memory (ROM), and a random access memory (RAM). Thecontroller 21 executes a predetermined program to control an operationof the entire recording device 1.

In the controller 21, a Data Base information generation unit 21A isrealized by executing a predetermined program. The Data Base informationgeneration unit 21A describes the number of pieces of tone_mapping_infoof a video stream supplied from the encoding processing unit 22 asnumber_of_tone_mapping_info_ref of the video stream of a main video ofSTN_table (FIG. 16) of PlayList and describes tone_map_id astone_mapping_info_ref.

Further, the Data Base information generation unit 21A describes thenumber of pieces of tone_mapping_info of a graphics stream supplied fromthe encoding processing unit 22 as number_of_tone_mapping_info_ref ofthe graphics stream of PlayList and describes tone_map_id astone_mapping_info_ref.

Further, the Data Base information generation unit 21A describes thenumber of pieces of tone_mapping_info inserted into the video streamsupplied from the encoding processing unit 22 asnumber_of_tone_mapping_info_ref of [Video Block] (FIG. 18) of ClipInformation and describes tone_map_id as tone_mapping_info_ref. The DataBase information generation unit 21A generates PlayList and ClipInformation which are Data Base information by describing the variouskinds of information, as described above, and outputs PlayList and ClipInformation to the disc drive 23.

The encoding processing unit 22 encodes the master HDR data. Theencoding processing unit 22 outputs the video stream and the graphicsstream obtained by encoding the master HDR data to the disc drive 23.The encoding processing unit 22 supplies the controller 21 withtone_map_id and the number of pieces of tone_mapping_info of the videostream, tone_map_id and the number of pieces of tone_mapping_info of thegraphics, and tone_map_id and the number of pieces of tone_mapping_infoinserted into the video stream.

The disc drive 23 records a file that stores the Data Base informationsupplied from the controller 21 and video stream and the graphics streamsupplied from the encoding processing unit 22 on the optical disc 11according to the directory structure in FIG. 15.

(Configuration of Encoding Processing Unit 22)

FIG. 22 is a block diagram illustrating a configuration example of theencoding processing unit in FIG. 21.

The encoding processing unit 22 is configured to include an HDRinformation generation unit 31, an HEVC encoder 32, an HDR-STDconversion unit 33, a definition information generation unit 34, anencoder 35, and a stream generation unit 36.

The HDR information generation unit 31 detects luminance of the inputmaster HDR data and generates HDR information including each piece ofinformation described with reference to FIG. 12. The HDR informationgeneration unit 31 outputs the generated HDR information to the streamgeneration unit 36.

When the recording mode is mode-i, the HEVC encoder 32 encodes the inputmaster HDR video in accordance with the HEVC scheme. When the recordingmode is mode-ii, the HEVC encoder 32 encodes the STD video supplied fromthe HDR-STD conversion unit 33 in accordance with the HEVC scheme. TheHEVC encoder 32 outputs the encoded data of the HDR video or the encodeddata of the STD data to the stream generation unit 36.

The HDR-STD conversion unit 33 converts the input master HDR data intothe STD data. The conversion performed by the HDR-STD conversion unit 33is appropriately performed according to conversion parameters input bythe author. The HDR-STD conversion unit 33 outputs, to the definitioninformation generation unit 34, information indicating a correspondencerelation between input data and output data in which RGB signals of theHDR data are set as the input data and RGB signals of the STD data areset as the output data.

(Signal Processing by HDR-STD Conversion Unit 33)

FIG. 23 is a block diagram illustrating an example of signal processingby the HDR-STD conversion unit 33.

As indicated by the tip of arrow #201, the HDR-STD conversion unit 33converts YCrCb signals of the input master HDR data into RGB signals andperforms conversion (tone mapping) on each of the RGB signals to converteach of the RGB signals into each of the RGB signals of the STD data.

The HDR-STD conversion unit 33 outputs, to the definition informationgeneration unit 34, information indicating a correspondence relationbetween the RGB signals of the HDR data, which is the input data, andthe RGB signals of the STD data, which is the output data. Theinformation output to the definition information generation unit 34 isused to generate the tone mapping definition information, as indicatedby the tip of arrow #202.

The HDR-STD conversion unit 33 converts the RGB signals of the STD datainto the YCrCb signals, as indicated by the tip of arrow #203, andoutputs the YCrCb signals.

FIG. 24 is a diagram illustrating an example of tone mapping.

The RGB signals of the HDR data are converted into the RGB signals ofthe STD data, for example, as illustrated in FIG. 24, such that ahigh-luminance component is compressed and intermediate and low bandluminance components are expanded. Information indicating a function Fassociating the RGB signals of the HDR data with the RGB signals of theSTD data, as illustrated in FIG. 24, is generated by the definitioninformation generation unit 34. The tone mapping definition informationgenerated using the information indicating the function F illustrated inFIG. 24 is tone_mapping_info of tone_map_model_id=3 in which therelation between coded_data and target_data is indicated by thepolygonal line function, as described with reference to FIG. 11.

Referring back to FIG. 22 for description, when the recording mode ismode-ii, the HDR-STD conversion unit 33 outputs the STD video obtainedby converting the HDR video to the HEVC encoder 32 and supplies the STDgraphics obtained by converting the HDR graphics to the encoder 35.

The definition information generation unit 34 generates the tone mappingdefinition information for HDR-STD conversion based on the informationsupplied from the HDR-STD conversion unit 33.

For example, when tone_map_model_id=0 is used, the definitioninformation generation unit 34 generates tone_mapping_info including thevalues of min_value and max_value in FIG. 9 as the tone mappingdefinition information for HDR-STD conversion.

When tone_map_model_id=2 is used, the definition information generationunit 34 generates tone_mapping_info including start_of_coded_interval[i]in FIG. 10 as the tone mapping definition information for HDR-STDconversion.

Further, when tone_map_model_id=3 is used, the definition informationgeneration unit 34 generates tone_mapping_info including the number ofpieces of coded_pivot_value[i] and the number of pieces oftarget_pivot_value[i] designated by num_pivots in FIG. 11 as the tonemapping definition information for HDR-STD conversion.

When the recording mode is mode-i, the encoder 35 encodes the inputmaster HDR graphics. When the recording mode is mode-ii, the encoder 35encodes the STD graphics supplied from the HDR-STD conversion unit 33.The encoder 35 outputs the graphics stream of the HDR graphics or theSTD graphics obtained as the encoding result to the stream generationunit 36.

The stream generation unit 36 supplies the controller 21 in FIG. 21 withthe number of pieces of tone_mapping_info including the HDR informationof the video stream supplied from the HDR information generation unit 31and the number of pieces of tone_mapping_info which is the tone mappingdefinition information of the video stream supplied from the definitioninformation generation unit 34. The stream generation unit 36 suppliesthe controller 21 with tone_map_id of tone_mapping_info.

The stream generation unit 36 supplies the controller 21 with the numberof pieces of tone_mapping_info including the HDR information of thegraphics stream supplied from the HDR information generation unit 31 andthe number of pieces of tone_mapping_info which is the tone mappingdefinition information of the graphics stream supplied from thedefinition information generation unit 34. The stream generation unit 36supplies the controller 21 with tone_map_id of tone_mapping_info.

The stream generation unit 36 supplies the controller 21 withtone_map_id and the number of pieces of tone_mapping_info of the videostream and the graphics stream as tone_map_id and the number of piecesof tone_mapping_info inserted into the video stream. The streamgeneration unit 36 inserts tone_mapping_info of the video stream and thegraphics stream as the SEI into the encoded data to generate the videostream. The stream generation unit 36 outputs the generated video streamand the graphics stream supplied from the encoder 35 to the disc drive23 in FIG. 21.

(Configuration of Reproduction Device 2)

FIG. 25 is a block diagram illustrating a configuration example of thereproduction device 2.

The reproduction device 2 is configured to include a controller 51, adisc drive 52, a memory 53, a local storage 54, a network interface 55,a decoding processing unit 56, a manipulation input unit 57, and an HDMIcommunication unit 58.

The controller 51 is configured to include a CPU, a ROM, and a RAM. Thecontroller 51 executes a predetermined program to control an operationof the entire reproduction device 2. For example, the controller 51supplies the decoding processing unit 56 with tone_mapping_info_ref ofthe video stream and the graphics stream described in PlayList suppliedfrom the disc drive 52.

The disc drive 52 reads data from the optical disc 11 and outputs theread data to the controller 51, the memory 53, or the decodingprocessing unit 56. For example, the disc drive 52 outputs the Data Baseinformation read from the optical disc 11 to the controller 51 andoutputs the video stream and the graphics stream to the decodingprocessing unit 56.

The memory 53 stores data or the like necessary for the controller 51 toperform various processes. In the memory 53, a register 53A which is aplayer status register (PSR) is formed. The register 53A stores variouskinds of information referred to at the time of reproduction of theoptical disc 11 by the reproduction device 2 which is a BD player.

The local storage 54 is configured to include, for example, a hard diskdrive (HDD). The local storage 54 records a stream or the likedownloaded from a server.

The network interface 55 communicates with the server via a network suchas the Internet and supplies data downloaded from the server to thelocal storage 54.

The decoding processing unit 56 is configured to include a videodecoding processing unit 56A and a graphics decoding processing unit56B. The video decoding processing unit 56A extracts tone_mapping_infoincluding the HDR information and tone_mapping_info which is the tonemapping definition information from the SEI of the video stream suppliedfrom the disc drive 52 and supplies tone_mapping_info to the graphicsdecoding processing unit 56B.

The video decoding processing unit 56A decodes the encoded data includedin the video stream in accordance with the HEVC scheme. The videodecoding processing unit 56A selects tone_mapping_info_ref of the videostream based on tone_mapping_info_ref of the video stream supplied fromthe controller 51. The video decoding processing unit 56A converts theHDR video or the STD video obtained as the decoding result into the STDvideo or the HDR video with reference to the tone mapping definitioninformation which is the selected tone_mapping_info and outputs the STDvideo or the HDR video to the HDMI communication unit 58, as necessary.When the video decoding processing unit 56A outputs the HDR video, thevideo decoding processing unit 56A outputs the HDR information includedin the selected tone_mapping_info to the HDMI communication unit 58along with the HDR video.

The graphics decoding processing unit 56B decodes the graphics stream.The graphics decoding processing unit 56B selects tone_mapping_infosupplied from the video decoding processing unit 56A based ontone_mapping_info_ref of the graphics stream supplied from thecontroller 51. The graphics decoding processing unit 56B converts theHDR graphics or the STD graphics obtained as the decoding result intothe STD graphics or the HDR graphics with reference to the tone mappingdefinition information which is the selected tone_mapping_info andoutputs the STD graphics or the HDR graphics to the HDMI communicationunit 58, as necessary. When the graphics decoding processing unit 56Boutputs the HDR graphics, the graphics decoding processing unit 56Boutputs the HDR information which is the selected tone_mapping_info tothe HDMI communication unit 58 along with the HDR graphics.

The manipulation input unit 57 is configured to include an input devicesuch as a button, a key, or a touch panel or a reception unit receivinga signal of infrared light or the like transmitted from a predeterminedremote commander. The manipulation input unit 57 detects a manipulationof a user and supplies a signal indicating content of the detectedmanipulation to the controller 51.

The HDMI communication unit 58 communicates with the display device 3via the HDMI cable 4. For example, the HDMI communication unit 58acquires information regarding the performance of the monitor includedin the display device 3 and outputs the information to the controller51. The HDMI communication unit 58 outputs the HDR video or the STDvideo supplied from the video decoding processing unit 56A to thedisplay device 3 and outputs the HDR graphics or the STD graphicssupplied from the graphics decoding processing unit 56B to the displaydevice 3. The HDMI communication unit 58 outputs the HDR informationsupplied from the video decoding processing unit 56A and the graphicsdecoding processing unit 56B to the display device 3.

(Configuration of Graphics Decoding Processing Unit)

FIG. 26 is a block diagram illustrating a configuration example of thegraphics decoding processing unit 56B in FIG. 25.

The graphics decoding processing unit 56B is configured to include a PIDfilter 71, a TS buffer 72, an ES buffer 73, a processor 74, a decoderbuffer 75, a graphics generation unit 76, a composition buffer 77, agraphics controller 78, a CLUT 79, a tone map retention unit 80, and atone conversion unit 81.

The PID filter 71 extracts packets of the graphics stream based on apacket ID (PID) of each packet of the video stream and the graphicsstream supplied from the disc drive 52. The PID is an ID unique to kindsof data that form the packets and is added to the packet.

The PID filter 71 supplies extracted transport stream (TS) packets ofthe graphics stream to the TS buffer 72 and allows the TS buffer 72 toretain the TS packets. The TS buffer 72 supplies an elementary stream(ES) formed by the retained TS packets to the ES buffer 73 and allowsthe ES buffer 73 to retain the ES.

The processor 74 reads the ES from the ES buffer 73 and supplies controldata of the graphics included in the ES to the composition buffer 77.For example, when the ES is the PG stream, the processor 74 supplies thePCS, the WDS, and the XPDS included in the PG stream to the compositionbuffer 77. On the other hand, when the ES is the IG stream, theprocessor 74 supplies the ICS and the XPDS included in the IG stream tothe composition buffer 77.

The processor 74 decodes actual data included in the ES, supplies thedecoded data, and allows the decoder buffer 75 to retain the data. Forexample, when the ES is the PG stream or the IG stream, the processor 74decodes the ODS and supplies the decoded ODS to the decoder buffer 75.

The graphics generation unit 76 generates and retains graphics in unitsof screens based on the ODS read and supplied from the decoder buffer 75at a timing controlled by the graphics controller 78. The graphicsgeneration unit 76 supplies the retained graphics in units of screens tothe CLUT 79 at a timing controlled by the graphics controller 78.

The composition buffer 77 retains the control data supplied from theprocessor 74.

The graphics controller 78 reads the control data from the compositionbuffer 77. The graphics controller 78 controls a reading timing in thedecoder buffer 75 and the graphics generation unit 76 based on the PCSor the WDS in the control data. The graphics controller 78 supplies theXPDS to the CLUT 79.

The CLUT 79 stores a table in which index colors and the values of Y,Cr, and Cb are associated with each other based on the XPDS suppliedfrom the graphics controller 78. The CLUT 79 converts the index colorsof the graphics supplied from the graphics generation unit 76 into thevalues of Y, Cr, and Cb based on the stored table and supplies thesevalues to the tone conversion unit 81.

The tone map retention unit 80 retains tone_mapping_info supplied fromthe video decoding processing unit 56A.

The tone conversion unit 81 reads tone_mapping_info in whichtone_mapping_info_ref is described as tone_map_id from the tone mapretention unit 80 based on tone_mapping_info_ref of the graphics streamsupplied from the controller 51.

For example, information indicating a recording mode specified bymode_flag included in Clip Information and information which isinformation regarding the performance of the monitor included in thedisplay device 3 and is specified by the information acquired from thedisplay device 3 are supplied from the controller 51 to the toneconversion unit 81.

When the HDR graphics are output to the display device 3, the toneconversion unit 81 outputs the HDR information included in the readtone_mapping_info to the HDMI communication unit 58. When the recordingmode is mode-i and the STD graphics are output to the display device 3,the tone conversion unit 81 converts the HDR graphics which are thegraphics supplied from the CLUT 79 into the STD graphics based on thetone mapping definition information for HDR-STD conversion which is theread tone_mapping_info. Then, the tone conversion unit 81 outputs theSTD graphics to the HDMI communication unit 58.

On the other hand, when the recording mode is mode-ii and the HDRgraphics are output to the display device 3, the tone conversion unit 81converts the STD graphics which are the graphics supplied from the CLUT79 into the HDR graphics based on the tone mapping definitioninformation for STD-HDR conversion which is the read tone_mapping_info.Then, the tone conversion unit 81 outputs the HDR graphics to the HDMIcommunication unit 58.

When the recording mode is mode-i and the HDR graphics are output to thedisplay device 3 or when the recording mode is mode-ii and the STDgraphics are output to the display device 3, the tone conversion unit 81outputs the graphics supplied from the CLUT 79 to the HDMI communicationunit 58 without conversion.

(Configuration of Display Device 3)

FIG. 27 is a block diagram illustrating a configuration example of thedisplay device 3.

The display device 3 is configured to include a controller 101, an HDMIcommunication unit 102, a signal processing unit 103, and a monitor 104.The controller 101 includes a memory 101A.

The controller 101 is configured to include a CPU, a ROM, and a RAM. Thecontroller 101 executes a predetermined program to control an operationof the entire display device 3.

For example, the controller 101 stores extended display identificationdata (EDID) indicating the performance of the monitor 104 in the memory101A for management. At the time of authentication with the reproductiondevice 2, the controller 101 outputs the EDID stored in the memory 101Ato the HDMI communication unit 102 and allows the HDMI communicationunit 102 to transmit the EDID to the reproduction device 2. Based on theEDID, the performance of the monitor 104 of the display device 3 isspecified by the reproduction device 2.

The HDMI communication unit 102 communicates with the reproductiondevice 2 via the HDMI cable 4. The HDMI communication unit 102 receivesthe HDR data or the STD data transmitted from the reproduction device 2and outputs the HDR data or the STD data to the signal processing unit103. The HDMI communication unit 102 transmits the EDID supplied fromthe controller 101 to the reproduction device 2.

The signal processing unit 103 performs a process on the HDR data or theSTD data supplied from the HDMI communication unit 102 and allows themonitor 104 to display a video.

Here, an operation of each device having the above-describedconfiguration will be described.

(Recording Process)

First, a recording process of the recording device 1 will be describedwith reference to the flowchart of FIG. 28. The recording process inFIG. 28 starts when the master HDR data is input to the recording device1.

In step S1, the controller 21 of the recording device 1 determineswhether the recording mode is mode-i. The recording mode is set by, forexample, an author.

When it is determined in step S1 that the recording mode is mode-i, theencoding processing unit 22 performs the encoding process of mode-i instep S2. The video stream and the graphics stream generated through theencoding process of mode-i are supplied to the disc drive 23.

On the other hand, when it is determined in step S1 that the recordingmode is mode-ii, the encoding processing unit 22 performs the encodingprocess of mode-ii in step S3. The video stream and the graphics streamgenerated through the encoding process of mode-ii are supplied to thedisc drive 23.

In step S4, the Data Base information generation unit 21A performs aData Base information generation process. The Data Base informationgenerated through the Data Base information generation process issupplied to the disc drive 23.

In step S5, the disc drive 23 records a file in which the video stream,the graphics stream, and the Data Base information are stored on theoptical disc 11. Thereafter, the process ends.

Next, the encoding process of mode-i performed in step S2 of FIG. 28will be described with reference to the flowchart of FIG. 29.

In step S11, the HDR information generation unit 31 of the encodingprocessing unit 22 detects the luminance of the master HDR data andgenerates the HDR information.

In step S12, the HEVC encoder 32 encodes the master HDR video inaccordance with the HEVC scheme to generate the encoded data of the HDRvideo.

In step S13, the encoder 35 encodes the master HDR graphics to generatethe graphics stream of the HDR graphics. The encoder 35 supplies thegraphics stream to the stream generation unit 36.

In step S14, the HDR-STD conversion unit 33 converts the input masterHDR data into the STD data. The definition information generation unit34 is supplied with the information indicating the correspondencerelation between the input data and the output data in which the RGBsignals of the HDR data are set as the input data and the RGB signals ofthe STD data are set as the output data.

In step S15, the definition information generation unit 34 generates thetone mapping definition information for HDR-STD conversion based on theinformation supplied from the HDR-STD conversion unit 33.

In step S16, the stream generation unit 36 inserts tone_mapping_infoincluding the HDR information generated by the HDR informationgeneration unit 31 and tone_mapping_info which is the tone mappingdefinition information generated by the definition informationgeneration unit 34 as the SEI of the encoded data into the encoded datato generate the video stream.

The stream generation unit 36 supplies the controller 21 with the numberof pieces of tone_mapping_info including the HDR information of thevideo stream and the number of pieces of tone_mapping_info which is thetone mapping definition information, and tone_map_id oftone_mapping_info. The stream generation unit 36 further supplies thecontroller 21 with the number of pieces of tone_mapping_info includingthe HDR information of the graphics stream and the number of pieces oftone_mapping_info which is the tone mapping definition information, andtone_map_id of tone_mapping_info. The stream generation unit 36 furthersupplies the controller 21 with tone_map_id and the number of pieces oftone_mapping_info of the video stream and the graphics stream astone_map_id and the number of pieces of tone_mapping_info inserted intothe video stream. Thereafter, the process returns to step S2 of FIG. 28and the subsequent process is performed.

Next, the encoding process of mode-ii performed in step S3 of FIG. 28will be described with reference to the flowchart of FIG. 30.

In step S21, the HDR information generation unit 31 of the encodingprocessing unit 22 detects the luminance of the master HDR data andgenerates the HDR information.

In step S22, the HDR-STD conversion unit 33 converts the input masterHDR data into the STD data. The definition information generation unit34 is supplied with the information indicating the correspondencerelation between the input data and the output data in which the RGBsignals of the HDR data are set as the input data and the RGB signals ofthe STD data are set as the output data.

In step S23, the definition information generation unit 34 generates thetone mapping definition information for STD-HDR conversion based on theinformation supplied from the HDR-STD conversion unit 33.

In step S24, the HEVC encoder 32 encodes the STD video obtained byconverting the master HDR video in accordance with the HEVC scheme togenerate the encoded data of the STD video.

In step S25, the encoder 35 encodes the STD graphics obtained byconverting the master HDR graphics to generate the graphics stream ofthe STD graphics.

In step S26, the stream generation unit 36 inserts tone_mapping_infoincluding the HDR information generated by the HDR informationgeneration unit 31 and tone_mapping_info which is the tone mappingdefinition information generated by the definition informationgeneration unit 34 as the SEI of the encoded data to generate the videostream. Thereafter, the process returns to step S3 of FIG. 28 and thesubsequent process is performed.

Next, the Data Base information generation process performed in step S4of FIG. 28 will be described with reference to the flowchart of FIG. 31.

In step S31, the Data Base information generation unit 21A of thecontroller 21 generates PlayList includingnumber_of_tone_mapping_info_ref and tone_mapping_info_ref of the videostream and the graphics stream described with reference to FIG. 16.Specifically, the Data Base information generation unit 21A describesthe number of pieces of tone_mapping_info of the video stream and thegraphics stream supplied from the encoding processing unit 22 asnumber_of_tone_mapping_info_ref in PlayList. The Data Base informationgeneration unit 21A describes tone_map_id of the video stream and thegraphics stream supplied from the encoding processing unit 22 astone_mapping_info_ref in PlayList.

In step S32, the Data Base information generation unit 21A generatesClip Information in which number_of_tone_mapping_info_ref andtone_mapping_info_ref are included in [Video Block] described withreference to FIGS. 17 and 18.

Specifically, the Data Base information generation unit 21A describesthe number of pieces of tone_mapping_info inserted into the video streamsupplied from the encoding processing unit 22 asnumber_of_tone_mapping_info_ref in [Video Block] of Clip Information.The Data Base information generation unit 21A describes tone_map_id oftone_mapping_info inserted into the video stream supplied from theencoding processing unit 22 as tone_mapping_info_ref in [Video Block] ofClip Information. Clip Information also includes HDR_flag and mode_flag.In this example, since the master data is the HDR data, 1 which is avalue indicating HDR data is set as the value of HDR_flag.

When the encoding process of mode-i is performed in step S2 of FIG. 28,the Data Base information generation unit 21A sets 1 which is the valueindicating that the recording mode is mode-i as a value of mode_flag. Onthe other hand, when the encoding process of mode-ii is performed instep S3 of FIG. 28, the Data Base information generation unit 21A sets 0which is a value indicating that the recording mode is mode-ii as thevalue of mode_flag. Thereafter, the process returns to step S4 of FIG.28 and the subsequent process is performed.

The recording device 1 records the video stream, the graphics stream,and the Data Base information generated through the foregoing processeson the optical disc 11.

(Reproduction Process)

Next, a reproduction process of the reproduction device 2 will bedescribed with reference to the flowchart of FIG. 32.

At a predetermined timing such as a timing before reproduction start ofthe optical disc 11, the controller 51 of the reproduction device 2communicates with the display device 3 by controlling the HDMIcommunication unit 58 and reads the EDID from the memory 101A of thedisplay device 3. The controller 51 allows the register 53A to store theinformation indicating the performance of the monitor included in thedisplay device 3 for management.

In step S41, the controller 51 reads PlayList which is the Data Baseinformation and Clip Information from the optical disc 11 by controllingthe disc drive 52. The controller 51 specifies the video stream and thegraphics stream to be reproduced based on the information included inPlayList and reads the specified video stream and graphics stream fromthe optical disc 11 by controlling the disc drive 52.

In step S42, the controller 51 refers to HDR_flag and mode_flag includedin Clip Information. In this example, a value indicating recording inwhich the master is the HDR data is set in HDR_flag. Thus, the recordingdevice 1 is in a state in which the recording device 1 reproduces theHDR data or the STD data obtained by converting the HDR data.

In step S43, the controller 51 determines whether the recording mode ismode-i based on the value of mode_flag.

When it is determined in step S43 that the recording mode is mode-i, thedecoding processing unit 56 performs the decoding process of mode-i instep S44.

On the other hand, when it is determined in step S43 that the recordingmode is mode-ii, the decoding processing unit 56 performs the decodingprocess of mode-ii in step S45.

After the decoding process is performed in step S44 or step S45, theprocess ends.

Next, the decoding process of mode-i performed in step S44 of FIG. 32will be described with reference to the flowchart of FIG. 33.

In step S61, the video decoding processing unit 56A extractstone_mapping_info from the SEI of the video stream and suppliestone_mapping_info to the graphics decoding processing unit 56B. The tonemap retention unit 80 of the graphics decoding processing unit 56Bretains tone_mapping_info supplied from the video decoding processingunit 56A.

In step S62, the video decoding processing unit 56A decodes the encodeddata included in the video stream in accordance with the HEVC scheme togenerate the HDR video.

In step S63, the graphics decoding processing unit 56B decodes thegraphics stream. Specifically, in the graphics decoding processing unit56B, the PID filter 71 extracts the graphics stream. Then, the graphicsdecoding processing unit 56B generates the values of Y, Cr, and Cb ofthe HDR graphics via the TS buffer 72, the ES buffer 73, the processor74, the decoder buffer 75, the graphics generation unit 76, thecomposition buffer 77, the graphics controller 78, and the CLUT 79 fromthe graphics stream. The values of Y, Cr, and Cb of the HDR graphics aresupplied to the tone conversion unit 81.

In step S64, the controller 51 determines whether the monitor includedin the display device 3 is the HDR monitor based on the informationstored in the register 53A. As described above, the register 53A storesthe information regarding the performance of the monitor included in thedisplay device 3 based on the EDID of the HDMI read from the displaydevice 3.

When it is determined in step S64 that the monitor included in thedisplay device 3 is the HDR monitor, the process proceeds to step S65.

In step S65, the video decoding processing unit 56A selectstone_mapping_info which includes tone_mapping_info_ref of the videostream described in PlayList supplied from the controller 51 astone_map_id and includes the HDR information from the extractedtone_mapping_info. The tone conversion unit 81 of the graphics decodingprocessing unit 56B selects tone_mapping_info which includestone_mapping_info_ref of the graphics stream described in PlayList astone_map_id and includes the HDR information from tone_mapping_info, andreads tone_mapping_info retained in the tone map retention unit 80.

In step S66, the video decoding processing unit 56A outputs the HDRvideo along with the HDR information of the selected video stream. Thetone conversion unit 81 of the graphics decoding processing unit 56Boutputs the HDR graphics along with the HDR information of the selectedgraphics stream.

Conversely, when it is determined in step S64 that the monitor includedin the display device 3 is not the HDR monitor but the STD monitor, theprocess proceeds to step S67.

In step S67, the video decoding processing unit 56A selectstone_mapping_info which is the tone mapping definition informationincluding tone_mapping_info_ref of the video stream described inPlayList supplied from the controller 51 as tone_map_id from theextracted tone_mapping_info. The tone conversion unit 81 of the graphicsdecoding processing unit 56B selects and reads tone_mapping_info whichis the tone mapping definition information includingtone_mapping_info_ref of the graphics stream described in PlayList astone_map_id from tone_mapping_info retained in the tone map retentionunit 80.

In step S68, the video decoding processing unit 56A converts the HDRvideo obtained as the decoding result into the STD video based on thetone mapping definition information for HDR-STD conversion of theselected video stream. The tone conversion unit 81 of the graphicsdecoding processing unit 56B converts the HDR graphics obtained as thedecoding result into the STD graphics based on the tone mappingdefinition information for HDR-STD conversion of the selected graphicsstream.

In step S69, the video decoding processing unit 56A outputs the STDvideo obtained through the conversion. The tone conversion unit 81 ofthe graphics decoding processing unit 56B outputs the STD graphicsobtained through the conversion.

After the HDR data is output in step S66 or the STD data is output instep S69, the controller 51 determines in step S70 whether thereproduction ends.

When the controller 51 determines in step S70 that the reproduction doesnot end, the process returns to step S61 and the controller 51repeatedly performs the foregoing processes. When the controller 51determines in step S70 that the reproduction ends, the process returnsto step S44 of FIG. 32 and the subsequent process is performed.

Next, the decoding process of mode-ii performed in step S45 of FIG. 32will be described with reference to the flowchart of FIG. 34.

In step S81, the video decoding processing unit 56A extractstone_mapping_info from the SEI of the video stream and suppliestone_mapping_info to the graphics decoding processing unit 56B. The tonemap retention unit 80 of the graphics decoding processing unit 56Bretains tone_mapping_info supplied from the video decoding processingunit 56A.

In step S82, the video decoding processing unit 56A decodes the encodeddata included in the video stream in accordance with the HEVC scheme togenerate the STD video.

In step S83, the graphics decoding processing unit 56B decodes thegraphics stream. The values of Y, Cr, and Cb of the STD graphicsobtained as the decoding result are supplied to the tone conversion unit81.

In step S84, the controller 51 determines whether the monitor includedin the display device 3 is the HDR monitor based on the informationstored in the register 53A.

When it is determined in step S84 that the monitor included in thedisplay device 3 is the HDR monitor, the process proceeds to step S85.

In step S85, the video decoding processing unit 56A selectstone_mapping_info which includes tone_mapping_info_ref of the videostream described in PlayList supplied from the controller 51 astone_map_id and includes the HDR information and tone_mapping_info whichis the tone mapping definition information from the extractedtone_mapping_info. The tone conversion unit 81 selects and readstone_mapping_info which includes tone_mapping_info_ref of the graphicsstream described in PlayList as tone_map_id and includes the HDRinformation and tone_mapping_info which is the tone mapping definitioninformation from the extracted tone_mapping_info retained in the tonemap retention unit 80.

In step S86, the video decoding processing unit 56A converts the STDvideo obtained as the decoding result into the HDR video based on thetone mapping definition information for STD-HDR conversion of theselected video stream. The tone conversion unit 81 converts the STDgraphics obtained as the decoding result into the HDR graphics based onthe tone mapping definition information for STD-HDR conversion of theselected graphics stream.

In step S87, the video decoding processing unit 56A outputs the HDRvideo obtained through the conversion along with the HDR information ofthe selected video stream. The tone conversion unit 81 outputs the HDRgraphics obtained through the conversion along with the HDR informationof the selected graphics stream.

On the other hand, when it is determined in step S84 that the monitorincluded in the display device 3 is the STD monitor, the processproceeds to step S88. In step S88, the video decoding processing unit56A outputs the STD video obtained as the decoding result and the toneconversion unit 81 outputs the STD graphics obtained through thedecoding result.

After the HDR data is output in step S87 or the STD data is output instep S88, the controller 51 determines in step S89 whether thereproduction ends.

When the controller 51 determines in step S89 that the reproduction doesnot end, the process returns to step S81 and the controller 51repeatedly performs the foregoing processes. When the controller 51determines in step S89 that the reproduction ends, the process returnsto step S45 of FIG. 32 and the subsequent process is performed.

(Display Process)

Next, a display process of the display device 3 will be described withreference to the flowchart of FIG. 35.

Here, a case in which the monitor 104 included in the display device 3is the HDR monitor will be described. The HDR data to which the HDRinformation is added is transmitted from the reproduction device 2 tothe display device 3 including the HDR monitor.

In step S101, the HDMI communication unit 102 of the display device 3receives the HDR data and the HDR information transmitted from thereproduction device 2.

In step S102, referring to the HDR information, the controller 101determines whether the HDR data transmitted from the reproduction device2 can be displayed without conversion. The HDR information includes theinformation indicating the luminance characteristics of the master HDRdata, that is, the HDR data transmitted from the reproduction device 2.The determination of step S102 is performed by comparing the luminancecharacteristics of the HDR data specified by the HDR information to thedisplay performance of the monitor 104.

For example, when the dynamic range of the HDR data specified by the HDRinformation is a range of 0% to 400% and the dynamic range of themonitor 104 is a range of 0% to 500% (for example, 500 cd/m² when thebrightness of 100% is assumed to be 100 cd/m²), it is determined thatthe HDR data can be displayed without conversion. On the other hand,when the dynamic range of the HDR data specified by the HDR informationis a range of 0% to 400% and the dynamic range of the monitor 104 is arange of 0% to 300%, it is determined that the HDR data cannot bedisplayed without conversion.

When it is determined in step S102 that the HDR data can be displayedwithout conversion, the signal processing unit 103 allows the monitor104 to display the video of the HDR data according to the luminancedesignated by the HDR information in step S103. For example, when theluminance characteristics indicated by the curved line L12 in FIG. 12are designated by the HDR information, each luminance value indicatesthe brightness in the range of 0% to 400% indicated by the curved lineL12.

Conversely, when it is determined in step S102 that the HDR data cannotbe displayed without conversion, the signal processing unit 103 adjuststhe luminance according to the display performance of the monitor 104and displays the video of the HDR data having the adjusted luminance instep S104. For example, when the luminance characteristics indicated bythe curved line L12 in FIG. 12 are designated by the HDR information andthe dynamic range of the monitor 104 is in the range of 0% to 300%, eachluminance value is compressed so that the brightness of the range of 0%to 300% is indicated.

After the video of the HDR data is displayed in step S103 or step S104,the controller 101 determines in step S105 whether the display ends.When it is determined that the display does not end, the processessubsequent to step S101 are repeated. When it is determined in step S105that the display ends, the controller 101 ends the process.

Through the foregoing series of processes, the recording device 1 canrecord the master HDR data as the HDR data on the optical disc 11, canallow the reproduction device 2 to reproduce the HDR data, and can allowthe display device 3 to display the video of the HDR data.

The recording device 1 can convert the master HDR data into the STDdata, record the STD data on the optical disc 11, allow the reproductiondevice 2 to restore the STD data to the HDR data, and allow the displaydevice 3 to display the video of the HDR data.

The luminance characteristics of the master HDR data can be set to bedesignated by the HDR information when the HDR data is reproduced. Thus,a content author can display the video of the HDR data with the intendedluminance.

The recording device 1 describes tone_map_id for identifyingtone_mapping_info of the graphics stream as tone_mapping_info_ref inPlayList. Accordingly, the reproduction device 2 can specifytone_mapping_info of the graphics stream among tone_mapping_infoinserted into the video stream based on tone_map_id.

Second Embodiment

(Configuration Example of AV Stream)

FIG. 36 is a diagram illustrating a configuration example of an AVstream in a second embodiment of the recording and reproduction systemto which the present technology is applied.

In the second embodiment, as illustrated in FIG. 36, tone_mapping_infois not included in a video stream, but included in an AV stream which isa new stream. That is, not only a video stream of a main video, an audiostream reproduced in synchronization with the video stream of the mainvideo, a video stream of a sub-video, a PG stream, a Text-ST stream, andan IG stream but also a stream of tone_mapping_info are multiplexed tothe AV stream according to the second embodiment.

At least one piece of tone_mapping_info is included in the Tone_mapstream which is the stream of the tone_mapping_info. Here,tone_mapping_info included in the Tone_map stream is used when a videostream or a graphics stream multiplexed to the Tone_map stream isreproduced.

The configurations of the PG stream, the Text-ST stream, and the IGstream according to the second embodiment are the same as theconfigurations of the PG stream, the Text-ST stream, and the IG streamaccording to the first embodiment.

(Syntax of Tone_Map Stream)

FIG. 37 is a diagram illustrating the syntax of the Tone_map stream.

As illustrated in the 4th line of FIG. 37, number_of_tone_mapping_infoindicating the number of pieces of tone_mapping_info included in theTone_map stream is described in the Tone_map stream. As illustrated inthe 6th to 9th lines, at least one piece of tone_mapping_info isdescribed in the Tone_map stream. The syntax of tone_mapping_info is thesame as that illustrated in FIG. 7.

(Syntax of Clip Information File)

FIG. 38 is a diagram illustrating the syntax of StreamCodingInfo of aClip Information file in the second embodiment.

As illustrated in FIG. 38A, [ToneMap Block] in the 7th line is describedin StreamCodingInfo according to the second embodiment in addition to[Video Block], [Audio Block], and [Graphics Block] described in FIG. 17.That is, since the Tone_map stream is included in the AV stream in thesecond embodiment, [ToneMap Block] indicating information regardingencoding of the Tone_map stream is described.

As illustrated in the 6th line of FIG. 38B,number_of_tone_mapping_info_ref indicating the number of pieces oftone_mapping_info included in the Tone_map stream is described in[ToneMap Block]. As illustrated in the 7th to 10th lines,tone_mapping_info_ref indicating tone_map_id of tone_mapping_infoincluded in the Tone_map stream is also described in [ToneMap Block].

In this way, by describing the number of pieces of tone_mapping_infoincluded in the Tone_map stream in the Clip Information file, thereproduction device 2 can recognize whether there is Tone_map streambefore reproduction of the video stream or the graphics stream.

The syntax of STN_table of a PlayList file according to the secondembodiment is the same as the syntax of STN_table in FIG. 16.

(Configuration of Encoding Processing Unit 22)

FIG. 39 is a diagram illustrating a configuration example of theencoding processing unit 22 of the recording device 1 in the secondembodiment of the recording and reproduction system to which the presenttechnology is applied.

In the configuration illustrated in FIG. 39, the same reference numeralsare given to the same configurations as the configurations in FIG. 22.The redundant description will be appropriately omitted.

The configuration of the encoding processing unit 22 in FIG. 39 isdifferent from the configuration in FIG. 22 in that a stream generationunit 121 is provided instead of the stream generation unit 36.

The stream generation unit 121 supplies the controller 21 with thenumber of pieces of tone_mapping_info including the HDR information ofthe video stream supplied from the HDR information generation unit 31and the number of pieces of tone_mapping_info which is the tone mappingdefinition information of the video stream supplied from the definitioninformation generation unit 34. The stream generation unit 121 suppliesthe controller 21 with tone_map_id of tone_mapping_info.

The number of pieces of tone_mapping_info of the video stream isdescribed as number_of_tone_mapping_info_ref of the video stream of themain video of STN_table (FIG. 16) of the PlayList file by the Data Baseinformation generation unit 21A. Further, tone_map_id of the videostream is described as tone_mapping_info_ref of the video stream ofSTN_table by the Data Base information generation unit 21A.

The stream generation unit 121 supplies the controller 21 with thenumber of pieces of tone_mapping_info including the HDR information ofthe graphics stream supplied from the HDR information generation unit 31and the number of pieces of tone_mapping_info which is the tone mappingdefinition information of the graphics stream supplied from thedefinition information generation unit 34. The stream generation unit121 supplies the controller 21 with tone_map_id of tone_mapping_info.

The number of pieces of tone_mapping_info of the graphics stream isdescribed as number_of_tone_mapping_info_ref of the graphics stream ofSTN_table of the PlayList file by the Data Base information generationunit 21A. Further, tone_map_id of the graphics stream is described astone_mapping_info_ref of the graphics stream of STN_table by the DataBase information generation unit 21A.

The stream generation unit 121 supplies the controller 21 withtone_map_id and the number of pieces of tone_mapping_info of the videostream and the graphics stream as tone_map_id and the number of piecesof tone_mapping_info inserted into the Tone_map stream. The number ofpieces of tone_mapping_info inserted into the video stream is describedas number_of_tone_mapping_info_ref of [ToneMap Block] (FIG. 38) of theClip Information file by the Data Base information generation unit 21A.Further, tone_map_id of tone_mapping_info inserted into the video streamis described as tone_mapping_info_ref of [ToneMap Block] by the DataBase information generation unit 21A.

The stream generation unit 121 generates the Tone_map stream includingtone_mapping_info of the video stream and the graphics stream andgenerates the video stream including the encoded data supplied from theHEVC encoder 32. The stream generation unit 121 outputs the generatedTone_map stream and video stream and the graphics stream supplied fromthe encoder 35 to the disc drive 23.

Thus, a stream file in which the Tone_map stream, the video stream, andthe graphics stream are stored is recorded on the optical disc 11according to the directory structure in FIG. 15.

(Configuration of Reproduction Device 2)

FIG. 40 is a diagram illustrating a configuration example of thereproduction device 2 of the second embodiment of the recording andreproduction system to which the present technology is applied.

In the configuration illustrated in FIG. 40, the same reference numeralsare given to the same configurations as the configurations in FIG. 25.The redundant description will be appropriately omitted.

The configuration of the reproduction device 2 in FIG. 40 is differentfrom the configuration in FIG. 25 in that a decoding processing unit 131is provided instead of the decoding processing unit 56.

The decoding processing unit 131 is configured to include a videodecoding processing unit 131A and a graphics decoding processing unit131B. The video decoding processing unit 131A extracts a video stream inthe AV streams read and supplied by the disc drive 52 and decodes theencoded data included in the video stream in accordance with the HEVCscheme.

The video decoding processing unit 131A extracts the Tone_map stream inthe streams read and supplied by the disc drive 52. The video decodingprocessing unit 131A extracts tone_mapping_info of the video stream fromthe Tone_map stream based on tone_mapping_info_ref of the video streamsupplied from the controller 51.

The video decoding processing unit 131A converts the HDR video or theSTD video obtained as the decoding result into the STD video or the HDRvideo with reference to the tone mapping definition information which isthe extracted tone_mapping_info and outputs the STD video or the HDRvideo to the HDMI communication unit 58, as necessary. When the videodecoding processing unit 131A outputs the HDR video, the video decodingprocessing unit 131A outputs the HDR information included in theextracted tone_mapping_info to the HDMI communication unit 58 along withthe HDR video.

The graphics decoding processing unit 131B extracts the graphics streamin the AV streams read and supplied by the disc drive 52 and decodes thegraphics stream. The graphics decoding processing unit 131B extracts theTone_map stream in the streams read and supplied by the disc drive 52.

The graphics decoding processing unit 131B extracts tone_mapping_info ofthe graphics stream from the Tone_map stream based ontone_mapping_info_ref of the graphics stream supplied from thecontroller 51. The graphics decoding processing unit 131B converts theHDR graphics or the STD graphics obtained as the decoding result intothe STD graphics or the HDR graphics with reference to the tone mappingdefinition information which is the extracted tone_mapping_info andoutputs the STD graphics or the HDR graphics to the HDMI communicationunit 58, as necessary. When the graphics decoding processing unit 131Boutputs the HDR graphics, the graphics decoding processing unit 131Boutputs the HDR information included in the extracted tone_mapping_infoto the HDMI communication unit 58 along with the HDR graphics.

(Configuration of Graphics Decoding Processing Unit 131B)

FIG. 41 is a block diagram illustrating a configuration example of thegraphics decoding processing unit 131B in FIG. 40.

In the configuration illustrated in FIG. 41, the same reference numeralsare given to the same configurations as the configurations in FIG. 26.The redundant description will be appropriately omitted.

The configuration of the graphics decoding processing unit 131B in FIG.41 is different from the configuration in FIG. 26 in that a PID filter141 and a tone map retention unit 142 are provided instead of the PIDfilter 71 and the tone map retention unit 80.

The PID filter 141 extracts packets of the graphics stream and theTone_map stream based on a packet ID of each packet of the video stream,the graphics stream, and the Tone_map stream supplied from the discdrive 52. As described above, the PID is an ID unique to the kinds ofdata that form the packets. Therefore, a different PID from the PID ofthe other AV streams such as the video stream and the graphics stream isadded to the packets of the Tone_map stream.

The PID filter 141 supplies the TS packets of the graphics stream to theTS buffer 72 to retain the TS packets. The PID filter 141 suppliestone_mapping_info included in the extracted Tone_map stream to the tonemap retention unit 142.

The tone map retention unit 142 retains tone_mapping_info supplied fromthe PID filter 141.

(Recording Process)

FIG. 42 is a flowchart for describing a recording process according tothe second embodiment of the recording device 1. The recording processin FIG. 42 starts when the master HDR data is input to the recordingdevice 1.

In step S111, the controller 21 of the recording device 1 determineswhether the recording mode is mode-i, as in the process of step S1 inFIG. 28.

When it is determined in step S111 that the recording mode is mode-i,the encoding processing unit 22 performs the encoding process of mode-iin step S112. The video stream, the graphics stream, and the Tone_mapstream generated through the encoding process of mode-i are supplied tothe disc drive 23.

On the other hand, when it is determined in step S111 that the recordingmode is mode-ii, the encoding processing unit 22 performs the encodingprocess of mode-ii in step S113. The video stream, the graphics stream,and the Tone_map stream generated through the encoding process ofmode-ii are supplied to the disc drive 23.

In step S114, the Data Base information generation unit 21A performs aData Base information generation process. The Data Base informationgenerated through the Data Base information generation process issupplied to the disc drive 23.

In step S115, the disc drive 23 records a file in which the videostream, the graphics stream, the Tone_map stream, and the Data Baseinformation are stored on the optical disc 11. Thereafter, the processends.

FIG. 43 is a flowchart for describing the encoding process of mode-iperformed in step S112 of FIG. 42.

Since the processes from steps S121 to S125 in FIG. 43 are similar tothe processes of steps S11 to S15 in FIG. 29, the description thereofwill be omitted.

In step S126, the stream generation unit 121 generates the Tone_mapstream including tone_mapping_info that includes the HDR informationgenerated by the HDR information generation unit 31 andtone_mapping_info which is the tone mapping definition informationgenerated by the definition information generation unit 34. The streamgeneration unit 121 supplies the Tone_map stream to the disc drive 23.

The stream generation unit 121 supplies the controller 21 with thenumber of pieces of tone_mapping_info including the HDR information ofthe video stream and the number of pieces of tone_mapping_info which isthe tone mapping definition information, and tone_map_id oftone_mapping_info. The stream generation unit 121 further supplies thecontroller 21 with the number of pieces of tone_mapping_info includingthe HDR information of the graphics stream and the number of pieces oftone_mapping_info which is the tone mapping definition information, andtone_map_id of tone_mapping_info. The stream generation unit 121 furthersupplies the controller 21 with tone_map_id and the number of pieces oftone_mapping_info of the video stream and the graphics stream astone_map_id and the number of pieces of tone_mapping_info inserted intothe Tone_map stream.

In step S127, the stream generation unit 121 generates the video streamincluding the encoded data supplied from the HEVC encoder 32 andsupplies the video stream to the disc drive 23. Thereafter, the processreturns to step S112 of FIG. 42 and the subsequent process is performed.

FIG. 44 is a flowchart for describing the encoding process of mode-iiperformed in step S113 of FIG. 42.

Since the processes from steps S141 to S145 in FIG. 44 are similar tothe processes of steps S21 to S25 in FIG. 30, the description thereofwill be omitted. Since the processes from steps S146 and S147 aresimilar to the processes of steps S126 and S127 in FIG. 43, thedescription thereof will be omitted.

FIG. 45 is a flowchart for describing the Data Base generation processperformed in step S114 of FIG. 42.

In step S161 of FIG. 45, the Data Base information generation unit 21Aof the controller 21 generates PlayList includingnumber_of_tone_mapping_info_ref and tone_mapping_info_ref of the videostream and the graphics stream, as in the process of step S31 in FIG.31.

In step S162, the Data Base information generation unit 21A generatesClip Information in which number_of_tone_mapping_info_ref andtone_mapping_info_ref are included in [ToneMap Block] described withreference to FIG. 38.

Specifically, the Data Base information generation unit 21A describesthe number of pieces of tone_mapping_info included in the Tone_mapstream supplied from the encoding processing unit 22 asnumber_of_tone_mapping_info_ref in [ToneMap Block] of Clip Information.The Data Base information generation unit 21A describes tone_map_id oftone_mapping_info included in the Tone_map stream supplied from theencoding processing unit 22 as tone_mapping_info_ref in [ToneMap Block]of Clip Information. Clip Information also includes HDR_flag andmode_flag.

The recording device 1 records the video stream, the graphics stream,the Tone_map stream, and the Data Base information generated through theforegoing processes on the optical disc 11.

(Reproduction Process)

FIG. 46 is a flowchart for describing a reproduction process accordingto the second embodiment of the reproduction device 2.

At a predetermined timing such as a timing before reproduction start ofthe optical disc 11, the controller 51 of the reproduction device 2communicates with the display device 3 by controlling the HDMIcommunication unit 58 and reads the EDID from the memory 101A of thedisplay device 3. The controller 51 allows the register 53A to store theinformation indicating the performance of the monitor included in thedisplay device 3 for management.

In step S171, the controller 51 reads PlayList which is the Data Baseinformation and Clip Information from the optical disc 11 by controllingthe disc drive 52. The controller 51 specifies the video stream, thegraphics stream, and the Tone_map stream to be reproduced based on theinformation included in PlayList. The controller 51 reads the specifiedvideo stream, graphics stream, and Tone_map stream from the optical disc11 by controlling the disc drive 52.

Since the processes from steps S172 and S173 are similar to theprocesses of steps S42 and S43 in FIG. 32, the description thereof willbe omitted.

When it is determined in step S173 that the recording mode is mode-i,the decoding processing unit 131 performs the decoding process of mode-iin step S174. The details of the decoding process of mode-i will bedescribed with reference to FIG. 47 to be described below.

On the other hand, when it is determined in step S173 that the recordingmode is mode-ii, the decoding processing unit 131 performs the decodingprocess of mode-ii in step S175. The details of the decoding process ofmode-ii will be described with reference to FIG. 47 to be describedbelow.

After the decoding process is performed in step S174 or step S175, theprocess ends.

FIG. 47 is a flowchart for describing a decoding process of mode-i instep S174 of FIG. 46.

In step S181, the video decoding processing unit 131A extractstone_mapping_info from the Tone_map stream supplied from the disc drive52. In the graphics decoding processing unit 131B, the PID filter 141extracts the Tone_map stream and tone_mapping_info is extracted from theTone_map stream to be retained in the tone map retention unit 142.

Since the processes from steps S182 to S190 are similar to the processesof steps S62 to S70 in FIG. 33, the description thereof will be omitted.After the process of step S190, the process returns to step S174 of FIG.46 and the subsequent process is performed.

FIG. 48 is a flowchart for describing details of a decoding process ofmode-ii in step S175 of FIG. 46.

Since the process of step S201 is similar to the process of step S181 ofFIG. 47 and the processes of steps S202 to S209 are similar to theprocesses of steps S82 to S89 in FIG. 34, the description thereof willbe omitted.

Third Embodiment

(Configurations of PG Stream and IG Stream)

FIG. 49 is a diagram illustrating a configuration example of a displayset of a PG stream and an IG stream in a third embodiment.

In the third embodiment, tone_mapping_info of the PG stream and the IGstream is not included in the video stream or the Tone_map stream, butis included in the PG stream and the IG stream.

Specifically, as illustrated in FIG. 49A, a tone_mapping_info definitionsegment (TDS) which is a segment describing tone_mapping_info ofsubtitles corresponding to one screen is prepared as a segment of adisplay set of the PG stream. As illustrated in FIG. 49B, a TDS which isa segment describing tone_mapping_info of a menu button corresponding toone screen is prepared as a segment of a display set of the IG stream.

In the XPDS of the PG stream, the number of pieces of tone_mapping_infoincluded in the TDS and tone_map_id for identifying tone_mapping_info ofsubtitles corresponding to the ODS are described in addition to thedescription of FIG. 20. The same also applies to the XPDS of the IGstream.

(Syntax of XPDS)

FIG. 50 is a diagram illustrating an example of the syntax of the XPDSin FIG. 49.

In the XPDS of FIG. 50, number_of_tone_mapping_info_ref in the 6th lineand tone_mapping_info_ref in the 7th to 10th lines are described inaddition to the description of FIG. 20. Here,number_of_tone_mapping_info_ref indicates the number of pieces oftone_mapping_info included in the TDS in the same display set as theXPDS including number_of_tone_mapping_info_ref. Further,tone_mapping_info_ref indicates tone_map_id for identifyingtone_mapping_info corresponding to the ODS in the same display set asthe XPDS including number_of_tone_mapping_info_ref.

In this way, in the third embodiment, tone_mapping_info is disposed inthe IG stream or the PG stream. Therefore,number_of_tone_mapping_info_ref and tone_mapping_info_ref are alsodisposed in the graphics stream. Accordingly, it is not necessary todispose number_of_tone_mapping_info_ref and tone_mapping_info_ref of thegraphics stream in PlayList. Accordingly, althoughnumber_of_tone_mapping_info_ref and tone_mapping_info_ref of thegraphics stream are assumed not to be disposed in PlayList in the thirdembodiment, they may be disposed therein.

(Syntax of TDS)

FIG. 51 is a diagram illustrating an example of the syntax of the TDS inFIG. 49.

As illustrated in the 4th line of FIG. 51, tone_mapping_info isdescribed in the TDS. Here, the syntax of tone_mapping_info is the sameas that illustrated in FIG. 7.

Although tone_mapping_info is assumed not to be included in the Text-STstream in the third embodiment, it may be included therein. In thiscase, for example, number_of_tone_mapping_info_ref andtone_mapping_info_ref are described in the DSS of the Text-ST stream.The TDS is prepared in the Text-ST stream.

The syntax of PlayList according to the third embodiment is the same asthe syntax of PlayList of the first embodiment including STN_table ofFIG. 16. However, 0 is set in PG_text_ST_tone_mapping_flag andIG_tone_mapping_flag. When tone_mapping_info of the Text-ST stream isincluded in the video stream, 1 is set in PG_text_ST_tone_mapping_flag,and the number of pieces of tone_mapping_info and tone_map_id oftone_mapping_info are set.

StreamCodingInfo according to the third embodiment is the same asStreamCodingInfo of the first embodiment illustrated in FIGS. 17 and 18.Accordingly, the reproduction device 2 can recognize whethertone_mapping_info is included in the graphics stream before reproductionof the graphics stream based on number_of_tone_mapping_info included in[Graphics Block].

(Configuration of Encoding Processing Unit 22)

FIG. 52 is a diagram illustrating a configuration example of theencoding processing unit 22 of the recording device 1 in the thirdembodiment of the recording and reproduction system to which the presenttechnology is applied.

In the configuration illustrated in FIG. 52, the same reference numeralsare given to the same configurations as the configurations in FIG. 22.The redundant description will be appropriately omitted.

The configuration of the encoding processing unit 22 in FIG. 52 isdifferent from the configuration in FIG. 22 in that an HDR informationgeneration unit 160, a definition information generation unit 161, anencoder 162, and a stream generation unit 163 are provided instead ofthe HDR information generation unit 31, the definition informationgeneration unit 34, the encoder 35, and the stream generation unit 36.

The HDR information generation unit 160 detects the luminance of theinput master HDR data and generates the HDR information including eachpiece of information described with reference to FIG. 12. The HDRinformation generation unit 160 supplies the stream generation unit 163with the HDR information of the video stream among the generated HDRinformation and outputs the HDR information of the graphics stream tothe encoder 162.

The definition information generation unit 161 generates the tonemapping definition information for HDR-STD conversion of the videostream and the graphics stream based on the information supplied fromthe HDR-STD conversion unit 33, as in the definition informationgeneration unit 34 in FIG. 22. The definition information generationunit 161 supplies the encoder 162 with the tone mapping definitioninformation for HDR-STD conversion of the graphics stream and suppliesthe stream generation unit 163 with the tone mapping definitioninformation for HDR-STD conversion of the video stream.

When the recording mode is mode-i, the encoder 162 encodes the inputmaster HDR graphics to generate the graphics stream. When the recordingmode is mode-ii, the encoder 162 encodes the STD graphics supplied fromthe HDR-STD conversion unit 33 to generate the graphics stream.

The encoder 162 generates the TDS including tone_mapping_info which isthe tone mapping definition information for HDR-STD conversion of thegraphics stream supplied from the definition information generation unit161 and tone_mapping_info including the HDR information of the graphicsstream supplied from the HDR information generation unit 160.

The encoder 162 inserts the TDS into the graphics stream of the HDRgraphics or the STD graphics and outputs the HDR graphics or the STDgraphics to the stream generation unit 163. The encoder 162 supplies thecontroller 21 with tone_map_id and the number of pieces oftone_mapping_info of the graphics stream.

The stream generation unit 163 supplies the controller 21 with thenumber of pieces of tone_mapping_info including the HDR information ofthe video stream supplied from the HDR information generation unit 160and the number of pieces of tone_mapping_info which is the tone mappingdefinition information of the video stream supplied from the definitioninformation generation unit 161. The stream generation unit 163 suppliesthe controller 21 with tone_map_id of tone_mapping_info.

The stream generation unit 163 inserts tone_mapping_info of the videostream as the SEI into the encoded data to generate the video stream.The stream generation unit 163 outputs the generated video stream andthe graphics stream supplied from the encoder 162 to the disc drive 23.

(Configuration of Reproduction Device 2)

FIG. 53 is a diagram illustrating a configuration example of areproduction device 2 of the third embodiment of the recording andreproduction system to which the present technology is applied.

In the configuration illustrated in FIG. 53, the same reference numeralsare given to the same configurations as the configurations in FIG. 25.The redundant description will be appropriately omitted.

The configuration of the reproduction device 2 in FIG. 53 is differentfrom the configuration in FIG. 25 in that a decoding processing unit 171is provided instead of the decoding processing unit 56.

The decoding processing unit 171 is configured to include a videodecoding processing unit 171A and a graphics decoding processing unit171B. The video decoding processing unit 171A extracts the video streamin the AV streams read and supplied by the disc drive 52. The videodecoding processing unit 171A extracts tone_mapping_info including theHDR information and tone_mapping_info which is the tone mappingdefinition information from the SEI of the video stream. The videodecoding processing unit 171A decodes the encoded data included in thevideo stream in accordance with the HEVC scheme.

The video decoding processing unit 171A selects tone_mapping_info_ref ofthe video stream based on tone_mapping_info_ref of the video streamsupplied from the controller 51. The video decoding processing unit 171Aconverts the HDR video or the STD video obtained as the decoding resultinto the STD video or the HDR video with reference to the tone mappingdefinition information which is the selected tone_mapping_info andoutputs the STD video or the HDR video to the HDMI communication unit58, as necessary. When the video decoding processing unit 171A outputsthe HDR video, the video decoding processing unit 56A outputs the HDRinformation included in the selected tone_mapping_info to the HDMIcommunication unit 58 along with the HDR video.

The graphics decoding processing unit 171B extracts the graphics streamin the AV streams read and supplied by the disc drive 52 andtone_mapping_info from the TDS of the graphics stream. The graphicsdecoding processing unit 171B decodes the ODS of the graphics stream.

The graphics decoding processing unit 171B converts the HDR graphics orthe STD graphics obtained as the decoding result into the STD graphicsor the HDR graphics with reference to the tone mapping definitioninformation which is tone_mapping_info and outputs the STD graphics orthe HDR graphics to the HDMI communication unit 58, as necessary. Whenthe graphics decoding processing unit 171B outputs the HDR graphics, thegraphics decoding processing unit 171B outputs the HDR informationincluded in tone_mapping_info to the HDMI communication unit 58 alongwith the HDR graphics.

(Configuration of Graphics Decoding Processing Unit 171B)

FIG. 54 is a block diagram illustrating a configuration example of thegraphics decoding processing unit 171B in FIG. 53.

In the configuration illustrated in FIG. 54, the same reference numeralsare given to the same configurations as the configurations in FIG. 26.The redundant description will be appropriately omitted.

The configuration of the graphics decoding processing unit 171B in FIG.54 is different from the configuration in FIG. 26 in that a processor180, a composition buffer 181, a graphics controller 182, a tone mapretention unit 183, and a tone conversion unit 184 are provided insteadof the processor 74, the composition buffer 77, the graphics controller78, the tone map retention unit 80, and the tone conversion unit 81.

The processor 180 reads the ES from the ES buffer 73 and suppliescontrol data of the graphics included in the ES to the compositionbuffer 181. For example, when the ES is the PG stream, the processor 180supplies the PCS, the WDS, the XPDS, and the TDS included in the PGstream to the composition buffer 181. On the other hand, when the ES isthe IG stream, the processor 180 supplies the ICS, the XPDS, and the TDSincluded in the IG stream to the composition buffer 181. The processor180 decodes the ODS included in the ES and supplies the decoded ODS tothe decoder buffer 75.

The composition buffer 181 retains the control data supplied from theprocessor 180.

As described above, it can be recognized whether tone_mapping_info isincluded in the graphics stream before the reproduction of the graphicsstream based on number_of_tone_mapping_info included in [GraphicsBlock]. Accordingly, the composition buffer 181 ensures a capacityassumed as the capacity of tone_mapping_info as a storage capacity onlywhen it is recognized that tone_mapping_info is included in the graphicsstream. Thus, it is possible to prevent a storage capacity from beingensured unnecessarily in the composition buffer 181.

The graphics controller 182 reads the control data from the compositionbuffer 181. The graphics controller 182 controls a reading timing in thedecoder buffer 75 and the graphics generation unit 76 based on the PCSor the WDS in the control data. The graphics controller 182 supplies theXPDS to the CLUT 79.

The graphics controller 182 extracts tone_mapping_info from the TDS andsupplies tone_mapping_info to the tone map retention unit 183. Thegraphics controller 182 supplies tone_mapping_info_ref included in theXPDS to the tone conversion unit 184.

The tone map retention unit 183 retains tone_mapping_info supplied fromthe graphics controller 182.

The tone conversion unit 184 reads tone_mapping_info in whichtone_mapping_info_ref is described as tone_map_id from the tone mapretention unit 183 based on tone_mapping_info_ref supplied from thegraphics controller 182.

For example, information indicating a recording mode specified bymode_flag included in Clip Information and information which isinformation regarding the performance of the monitor included in thedisplay device 3 and is specified by the information acquired from thedisplay device 3 are supplied from the controller 51 to the toneconversion unit 184 in a way similar to the tone conversion unit 81.

The tone conversion unit 184 outputs the HDR information and the STDgraphics or the HDR graphics to the HDMI communication unit 58, as inthe tone conversion unit 81.

(Recording Process)

A recording process of the recording device 1 according to the thirdembodiment is similar to the recording process in FIG. 28 except for theencoding process of mode-i in step S2, the encoding process of mode-iiin step S3, and the Data Base information generation process in step S4.Accordingly, only the encoding process of mode-i, the encoding processof mode-ii, and the Data Base information generation process will bedescribed.

FIG. 55 is a flowchart for describing an encoding process of mode-i inthe encoding processing unit 22 in FIG. 52.

Since the processes from steps S221 to S225 in FIG. 55 are similar tothe processes of steps S11 to S15 in FIG. 29, the description thereofwill be omitted.

In step S226, the stream generation unit 163 inserts Tone_mapping_infoincluding the HDR information of the video stream generated by the HDRinformation generation unit 160 and tone_mapping_info which is the tonemapping definition information of the video stream generated by thedefinition information generation unit 161 as the SEI of the encodeddata into the encoded data to generate the video stream.

In step S227, the encoder 162 generates the TDS that includestone_mapping_info including the HDR information of the graphics streamsupplied from the HDR information generation unit 160 andtone_mapping_info which is the tone mapping definition information ofthe graphics stream supplied from the definition information generationunit 161.

In step S228, the encoder 162 inserts the TDS into the graphics streamand outputs the TDS to the stream generation unit 163. The encoder 162supplies the number of pieces of tone_mapping_info of the graphicsstream and tone_map_id to the controller 21. Then, the process ends.

FIG. 56 is a flowchart for describing an encoding process of mode-ii inthe encoding processing unit 22 in FIG. 52.

Since the processes of steps S241 to S245 in FIG. 56 are similar to theprocesses of steps S21 to S25 in FIG. 30 and the processes of steps S246to S248 are similar to the processes of steps S226 to S228 in FIG. 55,the description thereof will be omitted.

FIG. 57 is a flowchart for describing a Data Base information generationprocess of the Data Base information generation unit 21A.

In step S261, the Data Base information generation unit 21A generatesPlayList including number_of_tone_mapping_info_ref andtone_mapping_info_ref of the video stream described with reference toFIG. 16. Specifically, the Data Base information generation unit 21Adescribes the number of pieces of tone_mapping_info of the video streamsupplied from the encoding processing unit 22 asnumber_of_tone_mapping_info_ref in PlayList. The Data Base informationgeneration unit 21A describes tone_map_id of the video stream suppliedfrom the encoding processing unit 22 as tone_mapping_info_ref inPlayList.

In step S262, the Data Base information generation unit 21A generatesClip Information in which number_of_tone_mapping_info_ref andtone_mapping_info_ref are included in [Graphics Block] described withreference to FIGS. 17 and 18.

Specifically, the Data Base information generation unit 21A describesthe number of pieces of tone_mapping_info of the graphics streamsupplied from the encoding processing unit 22 asnumber_of_tone_mapping_info_ref in [Graphics Block] of Clip Information.The Data Base information generation unit 21A describes tone_map_id oftone_mapping_info of the graphics stream supplied from the encodingprocessing unit 22 as tone_mapping_info_ref in [Graphics Block] of ClipInformation. Clip Information also includes HDR_flag and mode_flag.

The recording device 1 records the video stream, the graphics stream,and the Data Base information generated through the foregoing processeson the optical disc 11.

(Reproduction Process)

The reproduction process of the reproduction device 2 according to thethird embodiment is similar to the reproduction process in FIG. 32except for the decoding process of mode-i in step S44 and the decodingprocess of mode-ii in step S45. Accordingly, only the decoding processof mode-i and the decoding process of mode-ii will be described.

FIG. 58 is a flowchart for describing a decoding process of the decodingprocessing unit 171 in mode-i in FIG. 53.

In step S281, the video decoding processing unit 171A extractstone_mapping_info from the SEI of the video stream.

In step S282, the video decoding processing unit 171A decodes theencoded data included in the video stream in accordance with the HEVCscheme to generate the HDR video.

In step S283, the graphics decoding processing unit 171B extractstone_mapping_info from the TDS of the graphics stream. Specifically, inthe graphics decoding processing unit 171B, the PID filter 71 extractsthe graphics stream and the control data is retained in the compositionbuffer 181 via the TS buffer 72, the ES buffer 73, and the processor180. The graphics controller 182 reads the TDS in the control data fromthe composition buffer 181 and extracts tone_mapping_info from the TDS.The graphics controller 182 supplies the extracted tone_mapping_info tothe tone map retention unit 183 and allows the tone map retention unit183 to retain tone_mapping_info.

The graphics controller 182 supplies tone_mapping_info_ref included inthe XPDS in the control data to the tone conversion unit 184.

In step S284, the graphics decoding processing unit 171B decodes the ODSof the graphics stream to generate values of Y, Cr, Cb of the HDRgraphics. The values of Y, Cr, and Cb of the HDR graphics are suppliedto the tone conversion unit 184.

In step S285, the controller 51 determines whether the monitor includedin the display device 3 is the HDR monitor based on the informationstored in the register 53A.

When it is determined in step S285 that the monitor included in thedisplay device 3 is the HDR monitor, the process proceeds to step S286.

In step S286, the video decoding processing unit 171A selectstone_mapping_info including tone_mapping_info_ref of the video streamdescribed in PlayList supplied from the controller 51 as tone_map_id andincluding the HDR information from the extracted tone_mapping_info. Thetone conversion unit 184 of the graphics decoding processing unit 171Bselects tone_mapping_info including tone_mapping_info_ref supplied fromthe graphics controller 182 as tone_map_id and including the HDRinformation from tone_mapping_info retained in the tone map retentionunit 183 and reads tone_mapping_info.

In step S287, the video decoding processing unit 171A outputs the HDRvideo along with the HDR information of the selected video stream. Thetone conversion unit 184 outputs the HDR graphics along with the HDRinformation of the selected graphics stream.

Conversely, when it is determined in step S285 that the monitor includedin the display device 3 is not the HDR monitor but the STD monitor, theprocess proceeds to step S288.

In step S288, the video decoding processing unit 171A selectstone_mapping_info which is the tone mapping definition informationincluding tone_mapping_info_ref of the video stream described inPlayList supplied from the controller 51 as tone_map_id from theextracted tone_mapping_info. The tone conversion unit 184 selectstone_mapping_info which is the tone mapping definition informationincluding tone_mapping_info_ref supplied from the graphics controller182 as tone_map_id from tone_mapping_info retained in the tone mapretention unit 183 and reads tone_mapping_info.

Since the processes from steps S289 to S291 are similar to the processesof steps S68 to S70 in FIG. 33, the description thereof will be omitted.

FIG. 59 is a flowchart for describing a decoding process of the decodingprocessing unit 171 in mode-ii in FIG. 53.

Since the processes from steps S301 to S305 are similar to the processesof steps S281 to S285 in FIG. 58, the description thereof will beomitted.

In step S306, the video decoding processing unit 171A selectstone_mapping_info which is the tone mapping definition informationincluding tone_mapping_info_ref of the video stream described inPlayList supplied from the controller 51 as tone_map_id and includes theHDR information and tone_mapping_info which is the tone mappingdefinition information from the extracted tone_mapping_info. The toneconversion unit 184 selects tone_mapping_info which is the tone mappingdefinition information including tone_mapping_info_ref supplied from thegraphics controller 182 as tone_map_id and includes the HDR informationand tone_mapping_info which is the tone mapping definition informationfrom tone_mapping_info retained in the tone map retention unit 183 andreads tone_mapping_info.

Since the processes from steps S307 to S310 are similar to the processesof steps S86 to S89 in FIG. 34, the description thereof will be omitted.

Fourth Embodiment

(BDJ Object)

FIG. 60 is a diagram for describing a screen generated based on a BDJobject.

As illustrated in FIG. 60, a screen (hereinafter referred to as a BDJscreen) which can be generated by a command of a BDJ applicationdescribed in the BDJ object is a screen of graphics and a backgroundimage. A screen (BDJ graphics plane) of graphics generated by the BDJobject is displayed on the front side of a screen (video plane) of avideo and a screen (background plane) of a background is displayed onthe rear side of the screen of the video.

In a fourth embodiment to which the present technology is applied,tone_mapping_info is used when a screen generated by the BDJ object isreproduced.

Tone_mapping_info at Time of Video Reproduction

FIG. 61 is a diagram for describing tone_mapping_info at the time ofvideo reproduction in a fourth embodiment to which the presenttechnology is applied.

In the fourth embodiment, as illustrated in FIG. 61, tone_mapping_infois also disposed in a video stream, as in the first embodiment. In theexample of FIG. 61, three pieces of tone_mapping_info #1 to #3 aredisposed.

As in the first embodiment, tone_map_id of tone_mapping_info of thevideo stream or the PG stream is designated in PlayList. In the exampleof FIG. 61, for example, tone_mapping_info #3 is designated astone_mapping_info of a video stream of a main video andtone_mapping_info #2 is designated as tone_mapping_info of the PGstream.

When tone_mapping_info is disposed in the video stream in this way andthe video stream is reproduced according to PlayList by the command ofthe BDJ object, tone_mapping_info of the BDJ screen can be acquired fromthe video stream.

Accordingly, tone_mapping_info of the BDJ screen at the time of videoreproduction is inserted into the video stream and is designated bytone_map_id for identifying tone_mapping_info in the BDJ object. In theexample of FIG. 61, 1 is designated as tone_map_id of tone_mapping_infoof the BDJ screen and tone_mapping_info #1 is used when the BDJ screenis reproduced.

FIG. 62 is a diagram illustrating an example of a command to designatetone_mapping_info for identifying tone_mapping_info of the BDJ screeninserted into the video stream described in the BDJ object.

A line number and a colon (:) on the left side of FIG. 62 are shown forconvenience of the description and are not included in the command. Thisis similar to FIG. 64 to be described below.

In the example of FIG. 62, as illustrated in the 4th line, 1 and 2 aredesignated as tone_map_id of tone_mapping_info of the BDJ screen.

Tone_mapping_info at Time of Video Stop

FIG. 63 is a diagram for describing tone_mapping_info at the time ofvideo stop in the fourth embodiment to which the present technology isapplied.

When tone_mapping_info is disposed in the video stream as in the firstembodiment, tone_mapping_info of the BDJ screen cannot be acquired fromthe video stream at the time of the video stop. Accordingly, a commandto generate tone_mapping_info of the BDJ screen at the time of the videostop and a command to designate tone_map_id for identifyingtone_mapping_info of a reproduction target BDJ screen intone_mapping_info are described in the BDJ object.

In the example of FIG. 63, commands to generate the pieces oftone_mapping_info #1 to #3 are described in the BDJ object. In thereproduction device 2, the pieces of tone_mapping_info #1 to #3 aregenerated according to the commands and are retained in a BDJ memory 191which is a memory for the BDJ object in the reproduction device 2.

In the example of FIG. 63, the commands to designate 1 and 2 astone_map_id of tone_mapping_info of the reproduction target BDJ screenare described in the BDJ object. In the reproduction device 2,tone_mapping_info #1 and tone_mapping_info #2 are retained in the BDJscreen memory 192 which is the memory for the BDJ screen in thereproduction device 2 according to the commands. Then, when thereproduction target BDJ screen is reproduced, tone_mapping_info #1 andtone_mapping_info #2 are used.

FIG. 64 is a diagram illustrating examples of a command to generatetone_mapping_info of a BDJ screen at the time of the video stop which isdescribed in the BDJ object and a command to designate tone_map_id foridentifying tone_mapping_info of the reproduction target BDJ screen intone_mapping_info.

Commands in the 2nd to 8th lines of FIG. 64 are commands to generatetone_mapping_info of tone_map_model_id=0 and tone_map_model_id=4 astone_mapping_info of the BDJ screen at the time of the video stop.

Commands in the 9th to 12th lines are commands to designate tone_map_idof the generated tone_mapping_info as tone_map_id of tone_mapping_infoof the reproduction target BDJ screen.

FIGS. 65 and 66 are diagrams illustrating the class structure of the BDJapplication necessary to execute the commands in FIGS. 62 and 64.

In FIG. 65, org.blurayx.hdr.ToneMapControl is a class in whichtone_mapping_info of the screen of the graphics generated by the BDJobject is set. Further, org.blurayx.hdr.BackgroundToneMapControl is aclass in which tone_mapping_info of the screen of the backgroundgenerated by the BDJ object is set. Further,org.blurayx.hdr.ToneMapFactory is a class in which tone_mapping_info isgenerated.

In FIG. 66, org.blurayx.hdr.ToneMap is a class in which commoninformation to models of all the tone maps is described intone_mapping_info. Further, org.blurayx.hdr.ToneMapLinear is a class inwhich tone_map_model_id=0 is described. Further,org.blurayx.hdr.ToneMapSigmoidal is a class in which tone_map_model_id=1is described. Further, org.blurayx.hdr.ToneMapUserDefinedTable is aclass in which tone_map_model_id=2 is described.

Here, org.blurayx.hdr.ToneMapPieceWiseLinear is a class in whichtone_map_model_id=3 is described. Further,org.blurayx.hdr.ToneMapLuminanceDynamicRangeInfo is a class in whichtone_map_model_id=4 is described.

(Configuration of Recording Device 1)

FIG. 67 is a diagram illustrating a configuration example of therecording device 1 of the fourth embodiment of the recording andreproduction system to which the present technology is applied.

The recording device 1 in FIG. 67 is configured to include a controller201, an encoding processing unit 202, and a disc drive 203. A master HDRvideo is input to the encoding processing unit 202.

The controller 201 is configured to include a CPU, a ROM, and a RAM. Thecontroller 201 executes a predetermined program to control an operationof the entire recording device 1.

In the controller 201, a predetermined program is executed to realize aData Base information generation unit 201A and a BDJ object generationunit 201B. The Data Base information generation unit 201A describes thenumber of pieces of tone_mapping_info of the video stream supplied fromthe encoding processing unit 202 as number_of_tone_mapping_info_ref ofthe video stream of the main video of PlayList and describes tone_map_idas tone_mapping_info_ref.

Further, the Data Base information generation unit 201A describes thenumber of pieces of tone_mapping_info inserted into the video streamsupplied from the encoding processing unit 202 asnumber_of_tone_mapping_info_ref of [Video Block] of Clip Information anddescribes tone_map_id in tone_mapping_info_ref. The Data Baseinformation generation unit 201A generates PlayList and Clip Informationwhich are Data Base information by describing the various kinds ofinformation, as described above, and outputs PlayList and ClipInformation to the disc drive 203.

The BDJ object generation unit 201B generates a BDJ object in which areproduction command to reproduce an AV stream according to the BDJscreen or the play list is described. The BDJ object generation unit201B generates the tone mapping definition information and the HDRinformation of the BDJ screen at the time of the video reproduction, asnecessary, and supplies the tone mapping definition information and theHDR information to the encoding processing unit 202. The BDJ objectgeneration unit 201B acquires tone_map_id of tone_mapping_info of theBDJ screen supplied from the encoding processing unit 202 at the time ofthe video reproduction.

The BDJ object generation unit 201B further describes a command todesignate the acquired tone_map_id in the BDJ object, as described withreference to FIG. 62. The BDJ object generation unit 201B generatestone_mapping_info which is the tone mapping definition information ofthe BDJ screen at the time of the video stop and tone_mapping_infoincluding the HDR information.

The BDJ object generation unit 201B further describes a command togenerate tone_mapping_info of the BDJ screen at the time of the videostop and a command to designate tone_map_id of tone_mapping_info in theBDJ object, as described with reference to FIG. 63. The BDJ objectgeneration unit 201B outputs the BDJ object to the disc drive 203.

The encoding processing unit 202 assigns tone_map_id totone_mapping_info supplied from the controller 201. The encodingprocessing unit 202 encodes the master HDR video. The encodingprocessing unit 202 inserts tone_mapping_info supplied from thecontroller 201 and tone_mapping_info of the video stream as the SEI intothe encoded data obtained by encoding the master HDR video and outputsthe encoded data to the disc drive 203. The encoding processing unit 202supplies the controller 201 with tone_map_id and the number of pieces oftone_mapping_info of the video stream and tone_map_id assigned totone_mapping_info of the BDJ screen at the time of the videoreproduction.

The disc drive 203 records PlayList, Clip Information, and the BDJobject supplied from the controller 201 and a file in which the videostream supplied from the encoding processing unit 202 is stored on theoptical disc 11 according to the directory structure in FIG. 15.

(Configuration of Encoding Processing Unit 202)

FIG. 68 is a block diagram illustrating a configuration example of theencoding processing unit 202 in FIG. 67.

The configuration of the encoding processing unit 202 in FIG. 68 isdifferent from the configuration of the encoding processing unit 22 inFIG. 22 in that an HDR information generation unit 211, an HDR-STDconversion unit 212, and a stream generation unit 213 are providedinstead of the HDR information generation unit 31, the HDR-STDconversion unit 33, and the stream generation unit 36 and the encoder 35is not provided.

The HDR information generation unit 211 detects luminance of the inputmaster HDR video and generates HDR information including each piece ofinformation described with reference to FIG. 12. The HDR informationgeneration unit 211 outputs the generated HDR information to the streamgeneration unit 213.

The HDR-STD conversion unit 212 converts the input master HDR video intothe STD video. The conversion performed by the HDR-STD conversion unit212 is appropriately performed according to conversion parameters inputby the author. The HDR-STD conversion unit 212 outputs, to thedefinition information generation unit 34, information indicating acorrespondence relation between input data and output data in which RGBsignals of the HDR video are set as the input data and RGB signals ofthe STD video are set as the output data.

When the recording mode is mode-ii, the HDR-STD conversion unit 212outputs the STD video obtained by converting the HDR video to the HEVCencoder 32.

The stream generation unit 213 supplies the number of pieces oftone_mapping_info including the HDR information supplied from the HDRinformation generation unit 211 and the number of pieces oftone_mapping_info which is the tone mapping definition informationsupplied from the definition information generation unit 34 as thenumber of pieces of tone_mapping_info of the video stream to thecontroller 201 in FIG. 67. The stream generation unit 213 supplies thecontroller 201 with tone_map_id of tone_mapping_info as tone_map_id ofthe video stream.

The stream generation unit 213 generates tone_mapping_info which is thetone mapping definition information of the BDJ screen at the time of thevideo reproduction which is supplied from the controller 201 andtone_mapping_info including the HDR information. The stream generationunit 213 supplies the controller 201 with tone_map_id of the generatedtone_mapping_info.

The stream generation unit 213 supplies the controller 201 with thevideo stream, and tone_map_id and the number of pieces oftone_mapping_info of the BDJ screen at the time of the videoreproduction as tone_map_id and the number of pieces oftone_mapping_info inserted into the video stream. The stream generationunit 213 inserts the video stream and tone_mapping_info of the BDJscreen at the time of the video reproduction as the SEI into the encodeddata to generate the video stream. The stream generation unit 213outputs the generated video stream to the disc drive 203 in FIG. 67.

(Configuration of Reproduction Device 2)

FIG. 69 is a block diagram illustrating a configuration example of thefourth embodiment of a reproduction device 2 to which the presenttechnology is applied.

The configuration of the reproduction device 2 in FIG. 69 is differentfrom the configuration in FIG. 25 in that a controller 221, a decodingprocessing unit 222, and a memory 223 are provided instead of thecontroller 51, the decoding processing unit 56, and the memory 53.

The controller 221 is configured to include a CPU, a ROM, and a RAM. Thecontroller 221 executes a predetermined program to control an operationof the entire reproduction device 2. For example, the controller 221supplies the decoding processing unit 222 with tone_mapping_info_ref ofthe video stream described in PlayList supplied from the disc drive 52.

In the controller 221, a BDJ object execution unit 221A is realized byexecuting a BDJ object supplied from the disc drive 52. The BDJ objectexecution unit 221A generates a BDJ screen of an HDR (hereinafterreferred to as an HDR screen) or a BDJ screen of an STD (hereinafterreferred to as an STD screen) according to the reproduction command. Atthe time of the video reproduction, the BDJ object execution unit 221Aacquires tone_mapping_info of tone_map_id designated by the command fromthe decoding processing unit 222.

The BDJ object execution unit 221A converts the generated HDR screen orSTD screen into the STD screen or the HDR screen with reference to thetone_mapping_info definition information which is the acquiredtone_mapping_info and supplies the STD screen or the HDR screen to theHDMI communication unit 58, as necessary. When the HDR screen is output,the BDJ object execution unit 221A outputs the HDR information includedin the acquired tone_mapping_info to the HDMI communication unit 58along with the HDR screen.

On the other hand, at the time of the video stop, the BDJ objectexecution unit 221A generates tone_mapping_info of the BDJ screenaccording to the command, supplies tone_mapping_info to the memory 223,and retains tone_mapping_info in the BDJ memory 191. The BDJ objectexecution unit 221A selects tone_mapping_info of tone_map_id fromtone_mapping_info retained in the memory 223 based on tone_map_id oftone_mapping_info of the reproduction target BDJ screen designated bythe command and retains tone_mapping_info in the BDJ screen memory 192.

The BDJ object execution unit 221A reads tone_mapping_info from the BDJscreen memory 192, as necessary. The BDJ object execution unit 221Aconverts the generated HDR screen or STD screen into the STD screen orthe HDR screen with reference to the tone_mapping_info definitioninformation which is the read tone_mapping_info and supplies the STDscreen or the HDR screen to the HDMI communication unit 58, asnecessary. When the HDR screen is output, the BDJ object execution unit221A outputs the HDR information included in the read tone_mapping_infoto the HDMI communication unit 58 along with the HDR screen.

The decoding processing unit 222 extracts tone_mapping_info from the SEIof the video stream supplied from the disc drive 52. The decodingprocessing unit 222 supplies the BDJ object execution unit 221A withtone_mapping_info of predetermined tone_map_id in the extractedtone_mapping_info in response to a request from the BDJ object executionunit 221A.

The decoding processing unit 222 decodes the encoded data included inthe video stream in accordance with the HEVC scheme. The decodingprocessing unit 222 selects tone_mapping_info_ref of the video streambased on tone_mapping_info_ref of the video stream supplied from thecontroller 221. The video decoding processing unit 222A converts the HDRvideo or the STD video obtained as the decoding result into the STDvideo or the HDR video with reference to the tone mapping definitioninformation which is the selected tone_mapping_info and outputs the STDvideo or the HDR video to the HDMI communication unit 58, as necessary.When the video decoding processing unit 222A outputs the HDR video, thevideo decoding processing unit 56A outputs the HDR information includedin the selected tone_mapping_info to the HDMI communication unit 58along with the HDR video.

The memory 223 stores data or the like necessary for the controller 221to perform various processes. In the memory 223, a register 223A whichis a PSR is formed. The register 223A stores various kinds ofinformation referred to at the time of reproduction of the optical disc11 by the reproduction device 2 which is a BD player. The register 223Aforms, for example, the BDJ memory 191 and the BDJ screen memory 192.

The BDJ memory 191 retains tone_mapping_info supplied from the BDJobject execution unit 221A. The BDJ screen memory 192 retainstone_mapping_info selected by the BDJ object execution unit 221A intone_mapping_info retained in the BDJ memory 191.

(Recording Process)

FIG. 70 is a flowchart for describing a recording process of therecording device 1 in FIG. 67. The recording process starts when themaster HDR video is input to the recording device 1.

In step S321, the BDJ object generation unit 201B of the recordingdevice 1 describes the reproduction command in the BDJ object.

In step S322, the BDJ object generation unit 201B generates the HDRinformation and the tone mapping definition information at the time ofthe video reproduction and the video stop on the BDJ screen. The BDJobject generation unit 201B supplies the HDR information and the tonemapping definition information at the time of the video reproduction tothe encoding processing unit 202.

In step S323, the BDJ object generation unit 201B describes the commandsto generate tone_mapping_info including the HDR information at the timeof the video stop and tone_mapping_info which is the tone mappingdefinition information and the command to designate tone_map_id oftone_mapping_info in the BDJ object.

In step S324, the controller 201 determines whether the recording modeis mode-i. The recording mode is set by, for example, an author.

When it is determined in step S324 that the recording mode is mode-i,the encoding processing unit 202 performs the encoding process of mode-iin step S325. Specifically, the encoding processing unit 202 performsthe processes of steps S11, S12, S14, and S15 in FIG. 29 on the video.Then, the process proceeds to step S327.

On the other hand, when it is determined in step S324 that the recordingmode is mode-ii, the encoding processing unit 202 performs the encodingprocess of mode-ii in step S326. Specifically, the encoding processingunit 202 performs the processes of steps S21 to S24 in FIG. 30 on thevideo. Then, the process proceeds to step S327.

In step S327, the stream generation unit 213 of the encoding processingunit 202 inserts tone_mapping_info including the HDR informationgenerated by the HDR information generation unit 211 andtone_mapping_info which is the tone mapping definition informationgenerated by the definition information generation unit 34 as the SEI ofthe encoded data into the encoded data. The stream generation unit 213generates tone_mapping_info which is the tone mapping definitioninformation of the BDJ screen at the time of the video reproductionwhich is supplied from the controller 201 and tone_mapping_infoincluding the HDR information. The stream generation unit 213 suppliesthe controller 201 with tone_map_id of the generated tone_mapping_info,and inserts them as the SEI of the encoded data into the encoded data

As described above, the stream generation unit 213 generates a videostream in which tone_mapping_info is inserted into the encoded data. Thestream generation unit 213 supplies the video stream to the disc drive23. The stream generation unit 213 supplies the controller 201 withtone_map_id of tone_mapping_info including the HDR information at thetime of the video reproduction and tone_mapping_info which is the tonemapping definition information.

The stream generation unit 213 supplies the controller 201 withtone_map_id and the number of pieces of tone_mapping_info of the videostream and tone_map_id and the number of pieces of tone_mapping_infoinserted into the video stream.

In step S328, the BDJ object generation unit 201B describes the commandto designate tone_map_id of tone_mapping_info at the time of the videoreproduction which is supplied from the stream generation unit 213 inthe BDJ object.

In step S329, the Data Base information generation unit 201A performsthe Data Base information generation process. Specifically, the DataBase information generation unit 201A performs the processes of stepsS31 and S32 of FIG. 31 on the video. Clip Information and the PlayListfile generated through the Data Base information generation process aresupplied to the disc drive 203.

In step S330, the disc drive 23 records the file in which the videostream, the Data Base information, and the BDJ object are stored on theoptical disc 11. Thereafter, the process ends.

(Reproduction Process)

Since the process of reproducing the video stream in the reproductiondevice 2 in FIG. 69 is similar to the process on the video in thereproduction process of FIG. 32, the description thereof will beomitted. This process is performed in response to the reproductioncommand to reproduce the video stream according to the play listdescribed in the BDJ object.

FIG. 71 is a flowchart for describing a BDJ screen reproduction processof the reproduction device 2 in FIG. 69.

In Step S340, the BDJ object execution unit 221A generates the BDJscreen in response to the reproduction command to reproduce the BDJscreen.

In step S341, the BDJ object execution unit 221A determines whether thevideo stream is being reproduced. When it is determined in step S341that the video stream is being reproduced, the process proceeds to stepS342.

In step S342, the BDJ object execution unit 221A selects and acquirestone_mapping_info of tone_map_id designated by the command described inthe BDJ object from tone_mapping_info extracted from the SEI by thedecoding processing unit 222. Then, the process proceeds to step S345.

When it is determined in step S341 that the video stream is beingreproduced, the process proceeds to step S343. In step S343, the BDJobject execution unit 221A generates tone_mapping_info including the HDRinformation and tone_mapping_info which is the tone mapping definitioninformation in response to the command described in the BDJ object andallows the BDJ memory 191 to retain tone_mapping_info.

In step S344, the BDJ object execution unit 221A selectstone_mapping_info of tone_map_id designated by the command described inthe BDJ object from tone_mapping_info retained in the BDJ memory 191 andallows the BDJ screen memory 192 to retain tone_mapping_info. The BDJobject execution unit 221A reads tone_mapping_info retained in the BDJscreen memory 192 and the process proceeds to step S345.

In step S345, when the monitor is the HDR monitor despitetone_mapping_info according to the kind of monitor included in thedisplay device 3 and the BDJ screen generated in step S340 is the STDscreen or the monitor is the STD monitor and the generated BDJ screen isthe HDR screen, the BDJ object execution unit 221A performs theconversion to the HDR screen or the STD screen with reference to thetone mapping definition information.

On the other hand, when the monitor is the HDR monitor despitetone_mapping_info and the BDJ screen generated in step S340 is the HDRscreen or the monitor is the STD monitor and the generated BDJ screen isthe STD screen, the BDJ object execution unit 221A does not perform theconversion of the BDJ screen.

The BDJ object execution unit 221A supplies the HDMI communication unit58 with the converted HDR screen or STD screen or the unconverted HDRscreen or STD screen. When the monitor is the HDR monitor, the BDJobject execution unit 221A supplies the HDMI communication unit 58 withthe HDR information included in tone_mapping_info.

In step S346, the controller 221 determines whether the reproductionends.

When it is determined in step S346 that the reproduction does not end,the process returns to step S340 and the controller 221 repeatedlyperforms the foregoing processes. When it is determined in step S346that the reproduction ends, the process ends.

Fifth Embodiment

(Configuration of Computer)

The above-described series of processing may be performed by hardware ormay be performed by software. When the series of processing is performedby software, a program forming the software is installed into a computerthat is incorporated in a dedicated hardware, or installed from aprogram storage medium into a general-purpose personal computer.

FIG. 72 is a block diagram showing a hardware configuration example of acomputer that performs the above-described series of processing using aprogram.

The CPU 501, the ROM 502 and the RAM 503 are mutually connected via abus 504.

Further, an input/output interface 505 is connected to the bus 504.Connected to the input/output interface 505 are an input unit 506 formedby a keyboard, a mouse, a microphone and the like, an output unit 507formed by a display, a speaker and the like, a storage unit 508 formedby a hard disk, a nonvolatile memory and the like, a communication unit509 formed by a network interface and the like, and a drive 510 thatactivates a removable medium 511.

In the computer configured as described above, the CPU 501 loads aprogram that is stored, for example, in the storage unit 508 onto theRAM 503 via the input/output interface 505 and the bus 504, and executesthe program. Thus, the above-described series of processing isperformed.

Programs to be executed by the CPU 501 may be recorded in the removablemedium 511, or may be provided via a wired or wireless transmissionmedium, such as a local area network, the Internet or digital satellitebroadcasting, and may be installed to the Storage medium 533

It should be noted that the program executed by a computer may be aprogram that is processed in time series according to the sequencedescribed in this specification or a program that is processed inparallel or at necessary timing such as upon calling.

The embodiment of the present technology is not limited to theabove-described embodiment, and various modifications are possibleinsofar as they do not depart from the essence of the presenttechnology.

For example, HDR_flag and mode_flag may be set independently in a videoand graphics. Further, when HDR_flag and mode_flag are fixed in advance,HDR_flag and mode_flag may not be recorded on the optical disc 11. Thereproduction device 2 may not transmit the HDR information to thedisplay device 3 even when the HDR data is transmitted to the displaydevice 3. The reproduction device 2 may be configured by a mobileterminal.

In the present specification, a system means a collective of a pluralityof constituent elements (devices, modules (components), or the like) andall of the constituent elements may not be present in the same casing.Accordingly, a plurality of devices accommodated in separate casings andconnected via networks and a single device in which a plurality ofmodules are accommodated in a single casing are all systems.

The present technology can also be applied to a recording andreproduction system in which Moving Picture Experts Group phase 4(MPEG4) is adopted as the encoding scheme.

Additionally, the present technology may also be configured as below.

-   (1)

A reproduction device including:

a reading unit configured to read association information, extendedgraphics, HDR information, and luminance conversion definitioninformation from a recording medium having recorded therein theassociation information which associates the extended graphics, whichare graphics having a second luminance range different from and broaderthan a first luminance range, with the HDR information indicating aluminance characteristic of the extended graphics, and the luminanceconversion definition information used when luminance conversion fromthe extended graphics to standard graphics which are graphics having thefirst luminance range is performed, the extended graphics, the HDRinformation, and the luminance conversion definition information;

a conversion unit configured to convert the extended graphics into thestandard graphics based on the luminance conversion definitioninformation associated with the extended graphics in the associationinformation; and

an output unit configured to output the extended graphics and the HDRinformation associated with the extended graphics in the associationinformation to a display device which is capable of displaying theextended graphics, and to output the standard graphics converted by theconversion unit to a display device which is not capable of displayingthe extended graphics.

-   (2)

The reproduction device according to (1),

wherein the association information is included in information regardingreproduction of the extended graphics.

-   (3)

The reproduction device according to (2),

wherein the recording medium is a Blu-ray disc, and

the association information is included in a PlayList file as theinformation regarding the reproduction.

-   (4)

The reproduction device according to any of (1) to (3),

wherein the luminance conversion definition information is firsttone_mapping_info in which one value among 0, 2, and 3 is set as a valueof tone_map_model_id, and

the HDR information is second tone_mapping_info in which 4 is set as thevalue of tone_map_model_id.

-   (5)

The reproduction device according to (4),

wherein the association information is information associating theextended graphics with tone_map_id of the first tone_mapping_info andtone_map_id of the second tone_mapping_info of the extended graphics.

-   (6)

The reproduction device according to any of (1) to (5),

wherein the association information associates an extended video whichis a video having a fourth luminance range different from and broaderthan a third luminance range with video HDR information indicating aluminance characteristic of the extended video and video luminanceconversion definition information used when luminance conversion fromthe extended video to a standard video which is a video having the thirdluminance range is performed,

the recording medium records the extended video, the video HDRinformation, and the video luminance conversion definition information,

the reading unit reads the extended video, the video HDR information,and the video luminance conversion definition information from therecording medium,

the conversion unit converts the extended video into the standard videobased on the video luminance conversion definition informationassociated with the extended video in the association information, and

the output unit outputs the extended video and the video HDR informationassociated with the extended video in the association information to adisplay device which is capable of displaying the extended video andoutputs the standard video converted by the conversion unit to a displaydevice which is not capable of displaying the extended video.

-   (7)

A reproduction method including:

a reading step of reading, by a reproduction device, associationinformation, extended graphics, HDR information, and luminanceconversion definition information, from a recording medium havingrecorded therein the association information which associates theextended graphics, which are graphics having a second luminance rangedifferent from and broader than a first luminance range, with the HDRinformation indicating a luminance characteristic of the extendedgraphics, and the luminance conversion definition information used whenluminance conversion from the extended graphics to standard graphicswhich are graphics having the first luminance range is performed, theextended graphics, the HDR information, and the luminance conversiondefinition information;

a conversion step of converting, by the reproduction device, theextended graphics into the standard graphics based on the luminanceconversion definition information associated with the extended graphicsin the association information; and

an output step of outputting, by the reproduction device, the extendedgraphics and the HDR information associated with the extended graphicsin the association information to a display device which is capable ofdisplaying the extended graphics, and outputting, by the reproductiondevice, the standard graphics converted in the conversion step to adisplay device which is not capable of displaying the extended graphics.

-   (8)

A recording medium recording:

association information configured to associate extended graphics whichare graphics having a second luminance range different from and broaderthan a first luminance range with HDR information indicating a luminancecharacteristic of the extended graphics, and luminance conversiondefinition information used when luminance conversion from the extendedgraphics to standard graphics, which are graphics having the firstluminance range is performed;

the extended graphics;

the HDR information; and

the luminance conversion definition information,

wherein a reproduction device reproducing the recording medium performsprocesses of

-   -   reading the association information, the extended graphics, the        HDR information, and the luminance conversion definition        information from the recording medium,    -   converting the extended graphics into the standard graphics        based on the luminance conversion definition information        associated with the extended graphics in the association        information, and    -   outputting the extended graphics and the HDR information        associated with the extended graphics in the association        information to a display device which is capable of displaying        the extended graphics, and outputting the converted standard        graphics to a display device which is not capable of displaying        the extended graphics.

-   (9)

A reproduction device including:

a reading unit configured to read association information, extendedgraphics, HDR information, and luminance conversion definitioninformation from a recording medium having recorded therein theassociation information which associates standard graphics, which aregraphics having a first luminance range, with the HDR informationindicating a luminance characteristic of the extended graphics, whichare graphics having a second luminance range different from and broaderthan the first luminance range and the luminance conversion definitioninformation used when luminance conversion from the standard graphics tothe extended graphics is performed, the standard graphics, the HDRinformation, and the luminance conversion definition information;

a conversion unit configured to convert the standard graphics into theextended graphics based on the luminance conversion definitioninformation associated with the standard graphics in the associationinformation; and

an output unit configured to output the extended graphics converted bythe conversion unit and the HDR information associated with the standardgraphics before the conversion in the association information to adisplay device which is capable of displaying the extended graphics, andto output the standard graphics to a display device which is not capableof displaying the extended graphics.

-   (10)

The reproduction device according to (9),

wherein the association information is included in information regardingreproduction of the standard graphics.

-   (11)

The reproduction device according to (10),

wherein the recording medium is a Blu-ray disc, and

the association information is included in a PlayList file as theinformation regarding the reproduction.

-   (12)

The reproduction device according to any of (9) to (11),

wherein the luminance conversion definition information is firsttone_mapping_info in which one value among 0, 2, and 3 is set as a valueof tone_map_model_id, and

the HDR information is second tone_mapping_info in which 4 is set as thevalue of tone_map_model_id.

-   (13)

The reproduction device according to (12),

wherein the association information is information associating thestandard graphics with tone_map_id of the first tone_mapping_info andtone_map_id of the second tone_mapping_info of the standard graphics.

-   (14)

The reproduction device according to any of (9) to (13),

wherein the association information associates a standard video which isa video having a third luminance range with video HDR informationindicating a luminance characteristic of an extended video which is avideo having a fourth luminance range different from and broader thanthe video with the third luminance range and video luminance conversiondefinition information used when luminance conversion from the standardvideo to the extended video is performed,

the recording medium records the standard video, the video HDRinformation, and the video luminance conversion definition information,

the reading unit reads the standard video, the video HDR information,and the video luminance conversion definition information from therecording medium,

the conversion unit converts the standard video into the extended videobased on the video luminance conversion definition informationassociated with the standard video in the association information, and

the output unit outputs the extended video converted by the conversionunit and the video HDR information associated with the standard videobefore the conversion in the association information to a display devicewhich is capable of displaying the extended video and outputs thestandard video to a display device which is not capable of displayingthe extended video.

-   (15)

A reproduction method including:

a reading step of reading, by a reproduction device, associationinformation, extended graphics, HDR information, and luminanceconversion definition information from a recording medium havingrecorded therein the association information which associates standardgraphics, which are graphics having a first luminance range, with theHDR information indicating a luminance characteristic of the extendedgraphics, which are graphics having a second luminance range differentfrom and broader than the first luminance range and the luminanceconversion definition information used when luminance conversion fromthe standard graphics to the extended graphics is performed, thestandard graphics, the HDR information, and the luminance conversiondefinition information;

a conversion step of converting, by the reproduction device, thestandard graphics into the extended graphics based on the luminanceconversion definition information associated with the standard graphicsin the association information; and

an output step of outputting, by the reproduction device, the extendedgraphics converted in the conversion step and the HDR informationassociated with the standard graphics before the conversion in theassociation information to a display device which is capable ofdisplaying the extended graphics, and outputting, by the reproductiondevice, the standard graphics to a display device which is not capableof displaying the extended graphics.

-   (16)

A recording medium recording:

association information which associates standard graphics which aregraphics having a first luminance range with HDR information indicatinga luminance characteristic of the extended graphics which are graphicshaving a second luminance range different from and broader than thefirst luminance range and the luminance conversion definitioninformation used when luminance conversion from the standard graphics tothe extended graphics is performed;

the standard graphics;

the HDR information; and

the luminance conversion definition information,

wherein a reproduction device reproducing the recording medium performsprocesses of

-   -   reading the association information, the extended graphics, the        HDR information, and the luminance conversion definition        information from the recording medium,    -   converting the standard graphics into the extended graphics        based on the luminance conversion definition information        associated with the standard graphics in the association        information, and    -   outputting the converted extended graphics and the HDR        information associated with the standard graphics before the        conversion in the association information to a display device        which is capable of displaying the extended graphics, and        outputting the standard graphics to a display device which is        not capable of displaying the extended graphics.

DESCRIPTION OF SYMBOLS

-   1 recording device-   2 reproduction device-   11 optical disc-   52 disc drive-   56 decoding processing unit-   56A video decoding processing unit-   58 HDMI communication unit-   81 tone conversion unit-   131 decoding processing unit-   131A video decoding processing unit-   171 decoding processing unit-   184 tone conversion unit-   221A BDJ object execution unit

The invention claimed is:
 1. A reproduction device, comprising: circuitry configured to: read association information, an extended graphics, a first HDR information, and a first luminance conversion definition information from a recording device, wherein the first luminance conversion definition information is first tone mapping info in which one value of 0, 2 or 3 is set as a first value of a tone map model id, wherein the first HDR information is second tone mapping info in which 4 is set as a second value of the tone map model id, wherein the recording device records: the association information which associates the extended graphics, which are first graphics having a first luminance range different from and broader than a second luminance range, with the first HDR information indicating a luminance characteristic of the extended graphics, and the first luminance conversion definition information, wherein the first luminance conversion definition information is used in luminance conversion from the extended graphics to a standard graphics, wherein the standard graphics are second graphics having the second luminance range, the extended graphics, the first HDR information, and the first luminance conversion definition information; convert the extended graphics into the standard graphics based on the first luminance conversion definition information associated with the extended graphics in the association information; and output the extended graphics and the first HDR information associated with the extended graphics in the association information to a first display device that displays the extended graphics; and output the converted standard graphics to a second display device that displays the standard graphics.
 2. The reproduction device according to claim 1, wherein the association information is included in first information regarding reproduction of the extended graphics.
 3. The reproduction device according to claim 2, wherein the recording device is a Blu-ray disc, and the association information is included in a PlayList file as the first information.
 4. The reproduction device according to claim 1, wherein the association information associates the extended graphics with a first tone_map_id of the first tone_mapping_info and a second tone_map_id of the second tone_mapping_info of the extended graphics.
 5. The reproduction device according to claim 1, wherein the association information associates an extended video which is a first video having a third luminance range different from and broader than a fourth luminance range with a second HDR information indicating a second luminance characteristic of the extended video and a second luminance conversion definition information, wherein the second luminance conversion definition information is used in luminance conversion from the extended video to a standard video, wherein the standard video is a second video having the fourth luminance range, wherein the recording device records the extended video, the second HDR information, and the second luminance conversion definition information, wherein the circuitry is further configured to: read the extended video, the second HDR information, and the second luminance conversion definition information from the recording device, convert the extended video into the standard video based on the second luminance conversion definition information associated with the extended video in the association information, and output the extended video and the second HDR information associated with the extended video in the association information to a third display device that displays the extended video; and output the converted standard video to a fourth display device that displays the standard video.
 6. A reproduction method, comprising: reading, by a reproduction device, association information, an extended graphics, HDR information, and a luminance conversion definition information, from a recording device, wherein the luminance conversion definition information is first tone mapping info in which one value of 0, 2 or 3 is set as a first value of a tone map model id, wherein the HDR information is second tone mapping info in which 4 is set as a second value of the tone map model id, wherein the recording device records: the association information which associates the extended graphics, which are first graphics having a first luminance range different from and broader than a second luminance range, with the HDR information indicating a luminance characteristic of the extended graphics, and the luminance conversion definition information, wherein the luminance conversion definition information is used in luminance conversion from the extended graphics to a standard graphics, wherein the standard graphics are second graphics having the second luminance range, the extended graphics, the HDR information, and the luminance conversion definition information; converting, by the reproduction device, the extended graphics into the standard graphics based on the luminance conversion definition information associated with the extended graphics in the association information; outputting, by the reproduction device, the extended graphics and the HDR information associated with the extended graphics in the association information to a first display device that displays the extended graphics; and outputting, by the reproduction device, the converted standard graphics to a second display device that displays the standard graphics.
 7. A non-transitory computer-readable medium having stored thereon, computer-executable instructions for causing a recording device to execute operations, the operations comprising: recording: association information that associates extended graphics, which are first graphics having a first luminance range different from and broader than a second luminance range, with HDR information indicating a luminance characteristic of the extended graphics, and a luminance conversion definition information, wherein the luminance conversion definition information is first tone mapping info in which one value of 0, 2 or 3 is set as a first value of a tone map model id, wherein the HDR information is second tone mapping info in which 4 is set as a second value of the tone map model id, wherein the luminance conversion definition information is used in luminance conversion from the extended graphics to a standard graphics, wherein the standard graphics are second graphics having the second luminance range; the extended graphics; the HDR information; and the luminance conversion definition information, wherein a reproduction device: reads the association information, the extended graphics, the HDR information, and the luminance conversion definition information from the recording device, converts the extended graphics into the standard graphics based on the luminance conversion definition information associated with the extended graphics in the association information, and outputs the extended graphics and the HDR information associated with the extended graphics in the association information to a first display device that displays the extended graphics; and outputs the converted standard graphics to a second display device that displays the standard graphics.
 8. A reproduction device, comprising: circuitry configured to: read association information, an extended graphics, a first HDR information, and a first luminance conversion definition information from a recording device, wherein the first luminance conversion definition information is first tone mapping info in which one value of 0, 2 or 3 is set as a first value of a tone map model id, wherein the first HDR information is second tone mapping info in which 4 is set as a second value of the tone map model id, wherein the recording device records: the association information which associates standard graphics, which are first graphics having a first luminance range, with the first HDR information indicating a first luminance characteristic of the extended graphics, which are second graphics having a second luminance range different from and broader than the first luminance range and the first luminance conversion definition information, wherein the first luminance conversion definition information is used in luminance conversion from the standard graphics to the extended graphics, the standard graphics, the first HDR information, and the first luminance conversion definition information; convert the standard graphics into the extended graphics based on the first luminance conversion definition information associated with the standard graphics in the association information; output the converted extended graphics and the first HDR information associated with the standard graphics in the association information to a first display device that displays the extended graphics; and output the standard graphics to a second display device that displays the standard graphics.
 9. The reproduction device according to claim 8, wherein the association information is included in first information regarding reproduction of the standard graphics.
 10. The reproduction device according to claim 9, wherein the recording device is a Blu-ray disc, and the association information is included in a PlayList file as the first information.
 11. The reproduction device according to claim 8, wherein the association information associates the standard graphics with a first tone_map_id of the first tone_mapping_info and a second tone_map_id of the second tone_mapping_info of the standard graphics.
 12. The reproduction device according to claim 8, wherein the association information associates a standard video which is a first video having a third luminance range with a second HDR information indicating a second luminance characteristic of an extended video which is a second video having a fourth luminance range different from and broader than the first video with the third luminance range and a second luminance conversion definition information, wherein the second luminance conversion definition information is used in luminance conversion from the standard video to the extended video, wherein the recording device records the standard video, the second HDR information, and the second luminance conversion definition information, wherein the circuitry is further configured to: read the standard video, the second HDR information, and the second luminance conversion definition information from the recording device, convert the standard video into the extended video based on the second luminance conversion definition information associated with the standard video in the association information; output the converted extended video and the second HDR information associated with the standard video in the association information to a third display device that displays the extended video; and output the standard video to a fourth display device that displays the standard video.
 13. A reproduction method, comprising: reading, by a reproduction device, association information, an extended graphics, HDR information, and a luminance conversion definition information from a recording device, wherein the luminance conversion definition information is first tone mapping info in which one value of 0, 2 or 3 is set as a first value of a tone map model id, wherein the HDR information is second tone mapping info in which 4 is set as a second value of the tone map model id, wherein the recording device records: the association information which associates standard graphics, which are first graphics having a first luminance range, with the HDR information indicating a luminance characteristic of the extended graphics, which are second graphics having a second luminance range different from and broader than the first luminance range and the luminance conversion definition information, wherein the luminance conversion definition information is used in luminance conversion from the standard graphics to the extended graphics, the standard graphics, the HDR information, and the luminance conversion definition information; converting, by the reproduction device, the standard graphics into the extended graphics based on the luminance conversion definition information associated with the standard graphics in the association information; outputting, by the reproduction device, the converted extended graphics and the HDR information associated with the standard graphics in the association information to a first display device that displays the extended graphics; and outputting, by the reproduction device, the standard graphics to a second display device that displays the standard graphics.
 14. A non-transitory computer-readable medium having stored thereon, computer-executable instructions for causing a recording device to execute operations, the operations comprising: recoding: association information which associates standard graphics, which are first graphics having a first luminance range, with HDR information indicating a luminance characteristic of an extended graphics, which are second graphics having a second luminance range different from and broader than the first luminance range, and luminance conversion definition information, wherein the luminance conversion definition information is first tone mapping info in which one value of 0, 2 or 3 is set as a first value of a tone map model id, wherein the HDR information is second tone mapping info in which 4 is set as a second value of the tone map model id, wherein the luminance conversion definition information is used in luminance conversion from the standard graphics to the extended graphics; the standard graphics; the HDR information; and the luminance conversion definition information, wherein a reproduction device: reads the association information, the extended graphics, the HDR information, and the luminance conversion definition information from the recording device, converts the standard graphics into the extended graphics based on the luminance conversion definition information associated with the standard graphics in the association information, and outputs the converted extended graphics and the HDR information associated with the standard graphics in the association information to a first display device that displays the extended graphics; and outputs the standard graphics to a second display device that displays the standard graphics. 